conductor

[conductor] task integration on conductor-worker-aarch64
[conductor] commit dc8b1e4df215 attempt 1
[conductor] image node:24-alpine
$ apk add --no-cache git
( 1/12) Installing brotli-libs (1.2.0-r1)
( 2/12) Installing c-ares (1.34.8-r0)
( 3/12) Installing libunistring (1.4.2-r0)
( 4/12) Installing libidn2 (2.3.8-r0)
( 5/12) Installing nghttp2-libs (1.69.0-r0)
( 6/12) Installing libpsl (0.21.5-r3)
( 7/12) Installing zstd-libs (1.5.7-r2)
( 8/12) Installing libcurl (8.22.0-r0)
( 9/12) Installing libexpat (2.8.4-r0)
(10/12) Installing pcre2 (10.48-r0)
(11/12) Installing git (2.54.0-r0)
(12/12) Installing git-init-template (2.54.0-r0)
Executing busybox-1.37.0-r31.trigger
OK: 24.0 MiB in 30 packages
$ npm install --no-audit --no-fund

added 78 packages in 4s
npm notice
npm notice New major version of npm available! 11.19.0 -> 12.0.2
npm notice Changelog: https://github.com/npm/cli/releases/tag/v12.0.2
npm notice To update run: npm install -g npm@12.0.2
npm notice
$ npm test

> conductor@0.4.3 test
> node --test "test/**/*.test.js"

✔ every tracked text file is pure ASCII (134.98615ms)
✔ no file uses CRLF line endings or trailing whitespace (87.8861ms)
✔ a password round trips and a wrong one is refused (24.74006ms)
✔ the same password hashes differently each time (17.24828ms)
✔ parameters are read back from the stored hash (11.81937ms)
✔ a malformed stored hash is refused rather than throwing (0.60763ms)
✔ password length is bounded (0.98476ms)
✔ a session token round trips its claims (1.75567ms)
✔ a token signed with another secret is refused (1.03319ms)
✔ a tampered payload is refused (0.45689ms)
✔ an expired token is refused (0.56493ms)
✔ a malformed token is refused rather than throwing (0.45448ms)
✔ cookies are parsed and issued (3.88458ms)
✔ the oidc login state round trips with its return path (1.03657ms)
✔ a missing return path means the root (0.32946ms)
✔ the oidc login state is refused when forged, stale or off-site (0.46338ms)
✔ oidc roles are collected from the usual claim shapes (0.57744ms)
✔ mask replaces secrets, longest first (0.45927ms)
✔ mask ignores very short values and leaves clean output alone (0.24327ms)
✔ health reports the selected drivers (298.64696ms)
✔ a signed trigger creates a job and expands the pipeline (280.35285ms)
✔ an unsigned or wrongly signed trigger is refused (88.00595ms)
✔ github and gitlab push payloads are understood (306.55014ms)
✔ a branch deletion is ignored rather than failing (123.91707ms)
✔ a broken pipeline is reported as a client error with detail (192.79846ms)
✔ a missing pipeline file is reported clearly (296.4797ms)
✔ a pipeline may be spelled .conductor.yaml instead of .conductor.yml (278.48206ms)
✔ a project pointed at a specific file gets no fallback (269.83449ms)
✔ a repository carrying both spellings is refused rather than guessed at (237.8005ms)
✔ a pipeline still using the jobs key is told what it was renamed to (387.12348ms)
✔ a job can be created directly, without a push payload to imitate (398.1106ms)
✔ creating a job requires the same signature as a trigger (125.23308ms)
✔ creating a job insists on a real commit rather than inferring one (104.69142ms)
✔ a job can be read back, with the state of every task (234.61802ms)
✔ a public job is readable without any credential at all (375.754ms)
✔ a private job needs the trigger secret, and is otherwise absent (351.33153ms)
✔ a job of another project cannot be read through this one (310.51111ms)
✔ a task can be read back on its own, and by its full name (409.68481ms)
✔ reading a task back carries its dependencies and matrix (404.00052ms)
✔ reading a task back never exposes its environment, services or script (257.47892ms)
✔ a task lists the artifacts it stored, with a usable download url (280.83379ms)
✔ reading a task back needs no worker token (258.91971ms)
✔ a private task is absent without a credential, and needs its project named (438.3226ms)
✔ a private task is readable by an administrator, by either path (565.6936ms)
✔ a task of another project cannot be read through this one (439.9758ms)
✔ an unknown task is 404 by either path (181.2533ms)
✔ the worker api rejects missing and invalid tokens (172.54265ms)
✔ independent tasks dispatch concurrently (383.22341ms)
✔ a task is only offered to a worker that satisfies its requires (314.09581ms)
✔ a worker is not offered work for an architecture it cannot build (441.25646ms)
✔ a claimed task carries everything the worker needs (430.84069ms)
✔ a task that requires a feature reports it to the worker (316.86668ms)
✔ the standard conductor variables are present in the task environment (356.13804ms)
✔ the source tarball is served from the mirror (440.31525ms)
✔ a worker cannot touch a task it does not hold (408.99053ms)
✔ log appends are resumable and deduplicated by offset (287.68335ms)
✔ an oversized log chunk is refused (420.52042ms)
✔ a finished log moves to storage and is still readable (344.86783ms)
✔ artifacts are stored, hashed, and stripped of traversal (387.13894ms)
✔ an artifact shorter than its content-length is rejected (275.51274ms)
✔ success releases dependents, matched on shared dimensions (449.91649ms)
✔ failure skips transitive dependents, not just direct ones (354.0208ms)
✔ a job settles as failed once every task is terminal (303.86572ms)
✔ a job settles as success when everything passes (296.65137ms)
✔ an allowed failure does not fail the job or block dependents (296.28897ms)
✔ a task with retries left is requeued instead of failing the job (276.73735ms)
✔ heartbeats keep a task alive and report cancellation (326.29654ms)
✔ the reaper fails a task whose worker stopped reporting (404.84214ms)
✔ a second push produces an independent, numbered job (518.55002ms)
﹣ jobs can be listed and filtered by project (1.14509ms) # the JSON API was removed
﹣ unknown jobs, tasks and artifacts return 404 (0.80594ms) # the JSON API was removed
✔ a disabled project refuses triggers (176.03602ms)
✔ a trigger for an unknown project is a 404 (117.88055ms)
✔ a commit that is not in the repository is refused (252.48284ms)
✔ a task is told to fetch an archive, and never the repository itself (269.49647ms)
✔ the source archive is the bare tree, with no wrapping directory (293.59458ms)
✔ the working directory is resolved from the pipeline, then the project (1001.38887ms)
✔ an unusable working directory is refused rather than sanitised (1272.17055ms)
✔ the trigger secret is not stored in the clear (203.98016ms)
✔ worker tokens are stored only as hashes (162.26553ms)
✔ defaults select sqlite, local storage and local auth (6.90983ms)
✔ configuring an s3 bucket switches the storage driver (0.79756ms)
✔ a partial s3 configuration is rejected rather than half applied (1.2499ms)
✔ configuring an oidc discovery url switches the auth mode (0.64027ms)
✔ an oidc discovery url without a client id is rejected (0.69073ms)
✔ a database url selects its dialect (1.15215ms)
✔ an unsupported database scheme is reported clearly (0.67561ms)
✔ a sqlite url collapses into database.path (6.77261ms)
✔ environment variables override the config file (39.88564ms)
✔ relative paths resolve against the config file directory (6.79864ms)
✔ a missing explicit config file is an error, a missing default is not (1.37948ms)
✔ a heartbeat timeout below the reap interval is rejected (5.98409ms)
✔ a non-integer port is rejected with the variable named (0.74048ms)
✔ parseKey accepts hex and base64, and rejects the wrong length (0.42611ms)
✔ stateDirs omits the storage directory when s3 is in use (1.21034ms)
✔ the loaded config is frozen (0.67751ms)
✔ topological order places dependencies first (2.64033ms)
✔ topological order is deterministic (2.9713ms)
✔ a cycle is detected and named (0.96353ms)
✔ depth reflects the longest path, not insertion order (0.41571ms)
✔ independent tasks are runnable at the same time (0.4883ms)
✔ a task becomes runnable only once every dependency succeeds (0.76292ms)
✔ a running dependency does not release its dependents (0.49408ms)
✔ failure skips transitive dependents, not just direct ones (0.58992ms)
✔ a skipped dependency never releases a dependent (0.94306ms)
✔ allowed failures can satisfy a dependency when asked to (0.53389ms)
✔ transitive dependents of a leaf is empty (0.33659ms)
✔ graph helpers tolerate dependencies outside the set (0.68617ms)
✔ dialect detection covers every supported scheme (9.2874ms)
✔ statement splitter respects literals and comments (3.12631ms)
✔ statement splitter keeps postgres dollar quoted bodies whole (1.95906ms)
✔ migrations apply once and are idempotent (62.55061ms)
✔ an edited migration is refused rather than silently diverging (21.56365ms)
✔ a migration removed from disk is reported (20.43865ms)
✔ rows come back as ordinary objects (22.50846ms)
✔ a conditional update claims exactly once (24.56301ms)
✔ deleting a job cascades to its tasks (28.2278ms)
✔ a failed transaction rolls back, and a failed savepoint keeps the outer work (24.79425ms)
﹣ migrations apply and retention sweeps on postgres (1.82178ms) # SKIP
﹣ migrations apply and retention sweeps on mysql (0.19322ms) # SKIP
✔ every example pipeline compiles (43.83402ms)
✔ the distribution example fans in per architecture (12.01321ms)
✔ the node example wires services and features (7.95643ms)
✔ git jobs with safe.directory set (1.94456ms)
✔ it appends to configuration already in the environment (0.31376ms)
✔ a count that is not a number does not corrupt the sequence (0.38172ms)
✔ git accepts the environment we build (149.91946ms)
✔ a file missing from a commit reads as missing, whatever sits in the working directory (104.99524ms)
﹣ the endpoints and key set come from the discovery document (1.74593ms) # docker is not available
✔ discovery reports a document that is missing an endpoint (43.63947ms)
✔ discovery reports an unreachable provider and a bad status (1.24789ms)
﹣ a token carrying the admin role authenticates as an administrator (0.35015ms) # the JSON API was removed
﹣ a token without the admin role is an ordinary user (0.17315ms) # the JSON API was removed
﹣ roles are recognised in the groups and resource_access shapes (0.36471ms) # the JSON API was removed
﹣ an OIDC user gets a local account and can own a project (0.29782ms) # the JSON API was removed
﹣ the same subject keeps one account even when the display name changes (0.46278ms) # the JSON API was removed
﹣ a display name colliding with a local account gets its own username (0.34194ms) # the JSON API was removed
﹣ a role revoked at the provider is lost on the next request (1.08087ms) # the JSON API was removed
﹣ an account disabled locally is refused despite a valid token (0.28416ms) # the JSON API was removed
﹣ a forged signature is refused (0.42706ms) # the JSON API was removed
﹣ an expired token is refused (0.35389ms) # the JSON API was removed
﹣ a token from a different issuer is refused (0.20919ms) # the JSON API was removed
﹣ an anonymous visitor asking for a protected page is sent to the provider (0.2165ms) # docker is not available
﹣ a browser signs in at the provider and comes back with a session (0.08085ms) # docker is not available
﹣ a callback with a forged state is refused (0.06244ms) # docker is not available
﹣ local passwords are refused while OIDC is in charge (0.0567ms) # the JSON API was removed
﹣ an OIDC administrator can drive the interface (0.05357ms) # docker is not available
﹣ worker ownership follows the OIDC identity (0.0522ms) # the JSON API was removed
✔ a pattern without a star matches exactly (11.02766ms)
✔ a star matches any job of characters (0.79081ms)
✔ the rest of a pattern is literal, not a regular expression (0.28944ms)
✔ a restricted task is left out of jobs for other refs (40.91671ms)
✔ it is left out rather than recorded as skipped (3.83178ms)
✔ tasks depending on an excluded task are excluded too (3.91984ms)
✔ depth and ordering describe the job that will happen (2.04054ms)
✔ without a ref nothing is filtered, so a pipeline can still be validated (2.72815ms)
✔ a restricted task cannot match a job that has no ref (4.14019ms)
✔ a malformed rule is reported rather than ignored (8.92984ms)
✔ the rule is not inherited from defaults (3.60352ms)
✔ a minimal pipeline compiles (26.99067ms)
✔ version is required and pinned (5.09631ms)
✔ empty and malformed documents are rejected clearly (3.75098ms)
✔ image and script are required (0.8033ms)
✔ image may come from defaults (1.18749ms)
✔ unknown keys are rejected, with a suggestion when close (5.70107ms)
✔ all problems are reported at once (1.45019ms)
✔ durations accept seconds, units and composites (2.65912ms)
✔ durations accept day and week units (1.84508ms)
✔ a malformed duration is rejected (1.88404ms)
✔ arch expands into one task per architecture (2.2343ms)
✔ a matrix expands to the cartesian product (1.63933ms)
✔ needs match on shared dimensions rather than fanning out (5.17027ms)
✔ a task without the shared dimension depends on every instance (2.51983ms)
✔ match all opts out of dimension matching (2.83043ms)
✔ needs may name one concrete instance (1.33185ms)
✔ an unsatisfiable dimension match is reported, not silently dropped (0.98633ms)
✔ needs on an unknown task lists what is defined (0.70158ms)
✔ self dependency is rejected (0.71395ms)
✔ a dependency cycle names the cycle (9.80264ms)
✔ interpolation substitutes arch and matrix values (4.03697ms)
✔ interpolating an undefined dimension is an error (1.23275ms)
✔ referring to arch without declaring one is an error (2.2551ms)
✔ matrix values must be safe for use in a task name (0.72409ms)
✔ arch may not also be a matrix dimension (0.62201ms)
✔ services get a derived alias and reject duplicates (7.69185ms)
✔ artifacts accept a bare list and reject absolute paths (2.34335ms)
✔ artifact when is constrained (0.57048ms)
✔ defaults are inherited and overridden per task (3.93392ms)
✔ env values must be scalars with valid names (0.85137ms)
✔ parsePipeline normalizes without expanding (5.78334ms)
✔ a realistic distribution pipeline produces the expected graph (1.42354ms)
✔ compiles markers to the placeholder each dialect expects (6.16689ms)
✔ numbers postgres placeholders per occurrence, including repeats (0.49999ms)
✔ ignores markers inside string literals and comments (0.43088ms)
✔ a json literal in default text survives untouched (0.25043ms)
✔ doubling a brace escapes it (0.28382ms)
✔ block comments are skipped, and nest only for postgres (0.27145ms)
✔ postgres dollar quoted bodies are skipped (0.33031ms)
✔ mysql backtick identifiers and hash comments are skipped (0.58963ms)
✔ a malformed marker is rejected with a useful message (1.03907ms)
✔ binds by name, resolving dotted paths (0.88869ms)
✔ an exact key beats path traversal (0.30691ms)
✔ reports every missing key at once (0.42521ms)
✔ rejects an array of parameters, which would silently bind by position (0.36066ms)
✔ normalizes booleans, dates and null (0.32281ms)
✔ rejects an object value, which is nearly always a forgotten stringify (0.40114ms)
✔ an artifact past its own deadline is deleted (358.12982ms)
✔ an explicit deadline overrides the policy in both directions (256.2332ms)
✔ an explicit deadline also beats the last good job (92.58079ms)
✔ the last few jobs keep their artifacts however old they are (161.49537ms)
✔ recent artifacts are kept however many jobs have followed (113.4701ms)
✔ an artifact outside both rules is deleted (168.05403ms)
✔ the most recent successful job is kept whatever the policy says (123.09594ms)
✔ only the latest success is protected, not every success (118.03226ms)
✔ a project may keep artifacts forever despite a server default (116.35525ms)
✔ a project setting overrides the server default (123.57923ms)
✔ an unfinished job is never swept (185.56508ms)
✔ logs older than the limit are removed but the task remains (112.59686ms)
✔ a swept log is distinguishable from one that never existed (129.44185ms)
✔ a log is swept only once (97.30478ms)
✔ zero keeps logs forever (100.64356ms)
✔ a storage failure leaves the row for the next pass (80.22751ms)
✔ a sweep deletes no more than its batch (140.86672ms)
✔ one project policy does not reach into another (195.41612ms)
✔ artifacts.expire in a pipeline reaches the stored artifact (378.75582ms)
﹣ the api reports and accepts project retention (0.24762ms) # the JSON API was removed
✔ seals and opens a value (5.22483ms)
✔ sealing twice produces different ciphertext (0.78766ms)
✔ without a key, values are stored as marked plaintext (0.49073ms)
✔ a keyed box can still read values written before a key existed (0.34996ms)
✔ an unkeyed box refuses encrypted values with an actionable message (3.44578ms)
✔ the wrong key fails to open (0.76755ms)
✔ tampering with the ciphertext is detected (0.87834ms)
✔ associated data binds a secret to its location (1.111ms)
✔ a key of the wrong size is refused at construction (0.6078ms)
✔ task ids are opaque, and say nothing about their job (6.00184ms)
✔ time ordered ids sort by creation time (0.39895ms)
✔ random ids use the expected alphabet (0.31388ms)
✔ slugify produces readable project ids and falls back when empty (0.59165ms)
✔ token hashing and constant time comparison (1.60584ms)
✔ the pipeline this project jobs on itself compiles (43.79894ms)
✔ its tasks declare the features they actually need (8.19906ms)
✔ publishing is restricted to main and release tags (49.2071ms)
✔ get-vanilla matches the reference signature (4.10719ms)
✔ get-vanilla-query-order-key-case matches the reference signature (1.15992ms)
✔ uriEncode percent encodes the characters encodeURIComponent leaves alone (0.31462ms)
✔ amzDate produces both required formats (0.30536ms)
✔ s3 requests carry the content hash header (0.73798ms)
✔ presigned urls carry the signature in the query string (3.53897ms)
✔ an already encoded path is not encoded a second time (0.81497ms)
✔ key validation rejects traversal and absolute paths (8.10622ms)
✔ sanitizeRelativePath strips traversal from worker supplied paths (0.7819ms)
✔ key layout is stable (0.95433ms)
✔ local backend round trips a buffer and reports its digest (31.8557ms)
✔ local backend serves ranges (10.10767ms)
✔ local backend accepts a stream (12.31508ms)
✔ local backend reports a missing object and deletes idempotently (7.36076ms)
✔ local backend has no presigned urls (1.7445ms)
✔ a partial write leaves no object behind (8.62369ms)
✔ part size grows so that a huge object still fits in 10000 parts (0.68009ms)
✔ inParts regroups an awkwardly chunked stream into fixed parts (2.21526ms)
✔ inParts handles a chunk far larger than the part size (0.65965ms)
✔ inParts yields nothing for an empty stream (0.47526ms)
﹣ s3 backend round trips awkward keys against a real server (0.08481ms) # docker is not available
﹣ s3 serves byte ranges (0.09604ms) # docker is not available
﹣ s3 accepts a stream when the size is known (0.07864ms) # docker is not available
﹣ a presigned url is usable without credentials (0.15779ms) # docker is not available
﹣ a tampered presigned url is rejected by the server (0.07591ms) # docker is not available
﹣ s3 reports a missing object and deletes idempotently (0.07259ms) # docker is not available
﹣ a stream of unknown length is accepted (5.48831ms) # docker is not available
﹣ a body past the single request threshold is uploaded in parts (0.08064ms) # docker is not available
﹣ a large body really is sent as several parts, and a small one is not (0.06231ms) # docker is not available
﹣ a multipart object still serves ranges (0.05882ms) # docker is not available
﹣ a body that does not match its declared size is rejected (0.05241ms) # docker is not available
﹣ a failed multipart upload does not leave parts behind (0.05198ms) # docker is not available
﹣ bad credentials fail loudly rather than silently storing nothing (0.05068ms) # docker is not available
✔ every javascript file parses (1044.07335ms)
✔ the shell scripts parse (5.83865ms)
✔ interpolated values are escaped by default (2.0942ms)
✔ quotes and ampersands are escaped inside attributes (0.32105ms)
✔ nested templates and arrays are kept, raw is passed through (0.39349ms)
✔ null, undefined and false render as nothing (0.25797ms)
✔ attrs omits absent values and renders bare booleans (0.80535ms)
✔ an anonymous visitor sees public jobs and an invitation to sign in (497.63488ms)
✔ an anonymous visitor cannot see a private job (261.19027ms)
✔ management pages redirect an anonymous visitor to sign in (208.65705ms)
✔ signing in through the form sets a session and reveals the nav (352.14989ms)
✔ a user creates a project through the form and is shown the secret once (238.41589ms)
✔ a project page shows variables and never their values (226.20173ms)
✔ setting and removing a variable returns the updated table (331.06903ms)
✔ a user cannot open or delete a project they do not own (396.29031ms)
✔ registering a worker shows the token once and lists it (166.38175ms)
✔ an ordinary user cannot create shared capacity from the form (371.64892ms)
✔ the users page is administrator only and warns about what deletion destroys (341.80214ms)
✔ a running job polls, and a finished one stops (478.99789ms)
✔ a task page streams the log and stops polling once it completes (319.00406ms)
✔ log output is escaped, so a task cannot inject markup into the page (431.81577ms)
✔ a mutation without the htmx header is refused (289.86534ms)
✔ the sign in form is centred rather than stranded at the left edge (171.52332ms)
✔ row actions stay ordinary table cells, so rows keep one height (208.39203ms)
✔ the stylesheet and htmx are served, and nothing else is (200.91134ms)
✔ the project page shows retention, with server defaults as placeholders (205.63936ms)
✔ saving retention through the form stores it, and empty means inherit (217.00533ms)
✔ a negative retention value is refused by the form (304.37309ms)
✔ the project page offers a working directory, defaulting to the server one (241.09388ms)
✔ saving a working directory stores it, and empty clears it (225.99416ms)
✔ an unusable working directory is refused by the form (239.38128ms)
✔ worker config loads from json and reports features (20.48234ms)
✔ worker config reads the token from a file (5.03854ms)
✔ environment overrides the worker config file (3.11102ms)
✔ worker config without a token is rejected (4.70655ms)
✔ a malformed feature is reported with its path (4.09096ms)
✔ shell quoting survives quotes and metacharacters (0.965ms)
✔ a generated script echoes each command and stops on failure (0.73748ms)
✔ container names are valid for docker and stay unique (2.20695ms)
✔ job arguments carry mounts, env, network and privilege (0.76586ms)
✔ a task container is created without sharing anything with the worker (0.69418ms)
✔ a feature still contributes its bind mounts (0.29804ms)
✔ features resolve into mounts, env and privilege (0.53989ms)
✔ an unknown required feature is reported rather than ignored (0.23163ms)
✔ an artifact pattern reduces to the part that can be copied out (0.45262ms)
✔ overlapping artifact paths are copied out once (0.52493ms)
✔ artifact collection globs, and refuses to leave the workspace (51.65382ms)
✔ artifact when controls collection (1.7131ms)
✔ an idle worker keeps running instead of exiting (4017.0391ms)
✔ a worker stops promptly on a signal rather than after its poll interval (1518.94771ms)
✔ log output is batched and offsets advance (2.09545ms)
✔ a conflicting offset resynchronises instead of duplicating (0.69925ms)
✔ secrets are masked before anything leaves the host (1.07883ms)
✔ a secret split across two writes is still masked (0.37552ms)
✔ a failing conductor does not break the task (0.76049ms)
ℹ tests 331
ℹ suites 0
ℹ pass 295
ℹ fail 0
ℹ cancelled 0
ℹ skipped 36
ℹ todo 0
ℹ duration_ms 20237.41466
[conductor] done