conductor

[conductor] task integration on conductor-worker-x86-64
[conductor] commit 97f8fcd6fa58 attempt 1
[conductor] image node:24-alpine
$ apk add --no-cache git
( 1/12) Installing brotli-libs (1.2.0-r1)
( 2/12) Installing c-ares (1.34.8-r0)
( 3/12) Installing libunistring (1.4.2-r0)
( 4/12) Installing libidn2 (2.3.8-r0)
( 5/12) Installing nghttp2-libs (1.69.0-r0)
( 6/12) Installing libpsl (0.21.5-r3)
( 7/12) Installing zstd-libs (1.5.7-r2)
( 8/12) Installing libcurl (8.22.0-r0)
( 9/12) Installing libexpat (2.8.4-r0)
(10/12) Installing pcre2 (10.48-r0)
(11/12) Installing git (2.54.0-r0)
(12/12) Installing git-init-template (2.54.0-r0)
Executing busybox-1.37.0-r31.trigger
OK: 23.3 MiB in 30 packages
$ npm install --no-audit --no-fund

added 78 packages in 5s
npm notice
npm notice New major version of npm available! 11.19.0 -> 12.0.2
npm notice Changelog: https://github.com/npm/cli/releases/tag/v12.0.2
npm notice To update run: npm install -g npm@12.0.2
npm notice
$ npm test

> conductor@0.4.2 test
> node --test "test/**/*.test.js"

✔ every tracked text file is pure ASCII (208.84462ms)
✔ no file uses CRLF line endings or trailing whitespace (92.623218ms)
✔ a password round trips and a wrong one is refused (25.54317ms)
✔ the same password hashes differently each time (26.784972ms)
✔ parameters are read back from the stored hash (27.2679ms)
✔ a malformed stored hash is refused rather than throwing (0.770276ms)
✔ password length is bounded (1.382193ms)
✔ a session token round trips its claims (3.041193ms)
✔ a token signed with another secret is refused (0.9418ms)
✔ a tampered payload is refused (0.700532ms)
✔ an expired token is refused (1.626154ms)
✔ a malformed token is refused rather than throwing (0.733149ms)
✔ cookies are parsed and issued (2.63618ms)
✔ the oidc login state round trips with its return path (1.217636ms)
✔ a missing return path means the root (0.340825ms)
✔ the oidc login state is refused when forged, stale or off-site (0.484461ms)
✔ oidc roles are collected from the usual claim shapes (0.654565ms)
✔ mask replaces secrets, longest first (0.472902ms)
✔ mask ignores very short values and leaves clean output alone (0.457024ms)
✔ health reports the selected drivers (429.497741ms)
✔ a signed trigger creates a job and expands the pipeline (212.111343ms)
✔ an unsigned or wrongly signed trigger is refused (116.208206ms)
✔ github and gitlab push payloads are understood (315.434493ms)
✔ a branch deletion is ignored rather than failing (111.874615ms)
✔ a broken pipeline is reported as a client error with detail (230.72729ms)
✔ a missing pipeline file is reported clearly (246.683624ms)
✔ a pipeline may be spelled .conductor.yaml instead of .conductor.yml (199.399499ms)
✔ a project pointed at a specific file gets no fallback (217.706299ms)
✔ a repository carrying both spellings is refused rather than guessed at (245.099366ms)
✔ a pipeline still using the jobs key is told what it was renamed to (243.199491ms)
✔ a job can be created directly, without a push payload to imitate (203.577655ms)
✔ creating a job requires the same signature as a trigger (124.883444ms)
✔ creating a job insists on a real commit rather than inferring one (85.500212ms)
✔ a job can be read back, with the state of every task (206.081859ms)
✔ a public job is readable without any credential at all (205.906712ms)
✔ a private job needs the trigger secret, and is otherwise absent (233.057365ms)
✔ a job of another project cannot be read through this one (213.825233ms)
✔ a task can be read back on its own, and by its full name (242.229156ms)
✔ reading a task back carries its dependencies and matrix (235.667831ms)
✔ reading a task back never exposes its environment, services or script (254.117352ms)
✔ a task lists the artifacts it stored, with a usable download url (301.779189ms)
✔ reading a task back needs no worker token (219.323657ms)
✔ a private task is absent without a credential, and needs its project named (214.096889ms)
✔ a private task is readable by an administrator, by either path (452.24367ms)
✔ a task of another project cannot be read through this one (239.683878ms)
✔ an unknown task is 404 by either path (105.270098ms)
✔ the worker api rejects missing and invalid tokens (88.348555ms)
✔ independent tasks dispatch concurrently (226.937238ms)
✔ a task is only offered to a worker that satisfies its requires (253.547359ms)
✔ a worker is not offered work for an architecture it cannot build (243.335158ms)
✔ a claimed task carries everything the worker needs (232.769046ms)
✔ a task that requires a feature reports it to the worker (205.121449ms)
✔ the standard conductor variables are present in the task environment (248.637734ms)
✔ the source tarball is served from the mirror (241.594322ms)
✔ a worker cannot touch a task it does not hold (212.002424ms)
✔ log appends are resumable and deduplicated by offset (245.094592ms)
✔ an oversized log chunk is refused (230.037959ms)
✔ a finished log moves to storage and is still readable (253.729484ms)
✔ artifacts are stored, hashed, and stripped of traversal (257.169298ms)
✔ an artifact shorter than its content-length is rejected (238.980967ms)
✔ success releases dependents, matched on shared dimensions (209.396714ms)
✔ failure skips transitive dependents, not just direct ones (242.496733ms)
✔ a job settles as failed once every task is terminal (289.500447ms)
✔ a job settles as success when everything passes (249.473144ms)
✔ an allowed failure does not fail the job or block dependents (234.512718ms)
✔ a task with retries left is requeued instead of failing the job (258.819851ms)
✔ heartbeats keep a task alive and report cancellation (262.922016ms)
✔ the reaper fails a task whose worker stopped reporting (263.736016ms)
✔ a second push produces an independent, numbered job (402.406966ms)
﹣ jobs can be listed and filtered by project (0.741113ms) # the JSON API was removed
﹣ unknown jobs, tasks and artifacts return 404 (0.257116ms) # the JSON API was removed
✔ a disabled project refuses triggers (129.167911ms)
✔ a trigger for an unknown project is a 404 (127.865807ms)
✔ a commit that is not in the repository is refused (239.989535ms)
✔ a task is told to fetch an archive, and never the repository itself (254.524649ms)
✔ the source archive is the bare tree, with no wrapping directory (239.745749ms)
✔ the working directory is resolved from the pipeline, then the project (756.149209ms)
✔ an unusable working directory is refused rather than sanitised (983.605537ms)
✔ the trigger secret is not stored in the clear (170.199185ms)
✔ worker tokens are stored only as hashes (86.399266ms)
✔ defaults select sqlite, local storage and local auth (7.539321ms)
✔ configuring an s3 bucket switches the storage driver (1.838422ms)
✔ a partial s3 configuration is rejected rather than half applied (2.4315ms)
✔ configuring an oidc discovery url switches the auth mode (1.388614ms)
✔ an oidc discovery url without a client id is rejected (1.332839ms)
✔ a database url selects its dialect (2.974108ms)
✔ an unsupported database scheme is reported clearly (1.480452ms)
✔ a sqlite url collapses into database.path (4.696285ms)
✔ environment variables override the config file (58.950957ms)
✔ relative paths resolve against the config file directory (10.556926ms)
✔ a missing explicit config file is an error, a missing default is not (3.649228ms)
✔ a heartbeat timeout below the reap interval is rejected (14.455911ms)
✔ a non-integer port is rejected with the variable named (4.635709ms)
✔ parseKey accepts hex and base64, and rejects the wrong length (0.676835ms)
✔ stateDirs omits the storage directory when s3 is in use (2.589977ms)
✔ the loaded config is frozen (1.020969ms)
✔ topological order places dependencies first (8.966147ms)
✔ topological order is deterministic (12.598309ms)
✔ a cycle is detected and named (2.557038ms)
✔ depth reflects the longest path, not insertion order (0.982867ms)
✔ independent tasks are runnable at the same time (1.135451ms)
✔ a task becomes runnable only once every dependency succeeds (2.874617ms)
✔ a running dependency does not release its dependents (0.54864ms)
✔ failure skips transitive dependents, not just direct ones (0.828537ms)
✔ a skipped dependency never releases a dependent (1.129904ms)
✔ allowed failures can satisfy a dependency when asked to (0.87855ms)
✔ transitive dependents of a leaf is empty (0.686022ms)
✔ graph helpers tolerate dependencies outside the set (0.654568ms)
✔ dialect detection covers every supported scheme (5.520132ms)
✔ statement splitter respects literals and comments (1.403653ms)
✔ statement splitter keeps postgres dollar quoted bodies whole (0.588453ms)
✔ migrations apply once and are idempotent (95.62872ms)
✔ an edited migration is refused rather than silently diverging (44.837735ms)
✔ a migration removed from disk is reported (36.696891ms)
✔ rows come back as ordinary objects (53.44336ms)
✔ a conditional update claims exactly once (39.099318ms)
✔ deleting a job cascades to its tasks (53.693737ms)
✔ a failed transaction rolls back, and a failed savepoint keeps the outer work (49.831392ms)
﹣ migrations apply and retention sweeps on postgres (2.21505ms) # SKIP
﹣ migrations apply and retention sweeps on mysql (0.36927ms) # SKIP
✔ every example pipeline compiles (74.850461ms)
✔ the distribution example fans in per architecture (23.440487ms)
✔ the node example wires services and features (14.000415ms)
✔ git jobs with safe.directory set (4.473721ms)
✔ it appends to configuration already in the environment (0.58461ms)
✔ a count that is not a number does not corrupt the sequence (0.64867ms)
✔ git accepts the environment we build (65.517086ms)
✔ a file missing from a commit reads as missing, whatever sits in the working directory (99.739289ms)
﹣ the endpoints and key set come from the discovery document (1.674043ms) # docker is not available
✔ discovery reports a document that is missing an endpoint (44.887837ms)
✔ discovery reports an unreachable provider and a bad status (1.73439ms)
﹣ a token carrying the admin role authenticates as an administrator (0.380833ms) # the JSON API was removed
﹣ a token without the admin role is an ordinary user (0.343681ms) # the JSON API was removed
﹣ roles are recognised in the groups and resource_access shapes (0.30573ms) # the JSON API was removed
﹣ an OIDC user gets a local account and can own a project (0.378563ms) # the JSON API was removed
﹣ the same subject keeps one account even when the display name changes (0.51483ms) # the JSON API was removed
﹣ a display name colliding with a local account gets its own username (0.631348ms) # the JSON API was removed
﹣ a role revoked at the provider is lost on the next request (0.584056ms) # the JSON API was removed
﹣ an account disabled locally is refused despite a valid token (0.234513ms) # the JSON API was removed
﹣ a forged signature is refused (0.394132ms) # the JSON API was removed
﹣ an expired token is refused (0.236521ms) # the JSON API was removed
﹣ a token from a different issuer is refused (2.298961ms) # the JSON API was removed
﹣ an anonymous visitor asking for a protected page is sent to the provider (0.204476ms) # docker is not available
﹣ a browser signs in at the provider and comes back with a session (0.136588ms) # docker is not available
﹣ a callback with a forged state is refused (0.132178ms) # docker is not available
﹣ local passwords are refused while OIDC is in charge (0.115162ms) # the JSON API was removed
﹣ an OIDC administrator can drive the interface (0.074828ms) # docker is not available
﹣ worker ownership follows the OIDC identity (0.071695ms) # the JSON API was removed
✔ a pattern without a star matches exactly (4.289467ms)
✔ a star matches any job of characters (0.859467ms)
✔ the rest of a pattern is literal, not a regular expression (0.595783ms)
✔ a restricted task is left out of jobs for other refs (41.305007ms)
✔ it is left out rather than recorded as skipped (4.788089ms)
✔ tasks depending on an excluded task are excluded too (6.592963ms)
✔ depth and ordering describe the job that will happen (3.316489ms)
✔ without a ref nothing is filtered, so a pipeline can still be validated (5.00267ms)
✔ a restricted task cannot match a job that has no ref (3.183493ms)
✔ a malformed rule is reported rather than ignored (12.776892ms)
✔ the rule is not inherited from defaults (6.471863ms)
✔ a minimal pipeline compiles (35.267953ms)
✔ version is required and pinned (8.355116ms)
✔ empty and malformed documents are rejected clearly (6.488098ms)
✔ image and script are required (1.75518ms)
✔ image may come from defaults (3.478307ms)
✔ unknown keys are rejected, with a suggestion when close (7.595329ms)
✔ all problems are reported at once (4.856343ms)
✔ durations accept seconds, units and composites (5.907764ms)
✔ durations accept day and week units (4.817982ms)
✔ a malformed duration is rejected (2.570082ms)
✔ arch expands into one task per architecture (4.234527ms)
✔ a matrix expands to the cartesian product (3.048984ms)
✔ needs match on shared dimensions rather than fanning out (8.115265ms)
✔ a task without the shared dimension depends on every instance (3.128297ms)
✔ match all opts out of dimension matching (2.378419ms)
✔ needs may name one concrete instance (3.658027ms)
✔ an unsatisfiable dimension match is reported, not silently dropped (1.678611ms)
✔ needs on an unknown task lists what is defined (0.871163ms)
✔ self dependency is rejected (1.228364ms)
✔ a dependency cycle names the cycle (4.039174ms)
✔ interpolation substitutes arch and matrix values (3.203962ms)
✔ interpolating an undefined dimension is an error (2.11503ms)
✔ referring to arch without declaring one is an error (2.51124ms)
✔ matrix values must be safe for use in a task name (1.441638ms)
✔ arch may not also be a matrix dimension (1.321268ms)
✔ services get a derived alias and reject duplicates (5.173514ms)
✔ artifacts accept a bare list and reject absolute paths (1.764733ms)
✔ artifact when is constrained (1.819883ms)
✔ defaults are inherited and overridden per task (2.413249ms)
✔ env values must be scalars with valid names (1.615741ms)
✔ parsePipeline normalizes without expanding (0.948147ms)
✔ a realistic distribution pipeline produces the expected graph (5.712433ms)
✔ compiles markers to the placeholder each dialect expects (14.246225ms)
✔ numbers postgres placeholders per occurrence, including repeats (0.575571ms)
✔ ignores markers inside string literals and comments (0.796888ms)
✔ a json literal in default text survives untouched (0.516444ms)
✔ doubling a brace escapes it (0.546245ms)
✔ block comments are skipped, and nest only for postgres (1.088779ms)
✔ postgres dollar quoted bodies are skipped (0.581691ms)
✔ mysql backtick identifiers and hash comments are skipped (1.256869ms)
✔ a malformed marker is rejected with a useful message (3.157985ms)
✔ binds by name, resolving dotted paths (2.773433ms)
✔ an exact key beats path traversal (0.905814ms)
✔ reports every missing key at once (0.815953ms)
✔ rejects an array of parameters, which would silently bind by position (2.614892ms)
✔ normalizes booleans, dates and null (0.486452ms)
✔ rejects an object value, which is nearly always a forgotten stringify (0.539528ms)
✔ an artifact past its own deadline is deleted (390.803361ms)
✔ an explicit deadline overrides the policy in both directions (200.975292ms)
✔ an explicit deadline also beats the last good job (103.576076ms)
✔ the last few jobs keep their artifacts however old they are (101.966504ms)
✔ recent artifacts are kept however many jobs have followed (95.816244ms)
✔ an artifact outside both rules is deleted (93.912887ms)
✔ the most recent successful job is kept whatever the policy says (100.098113ms)
✔ only the latest success is protected, not every success (123.482232ms)
✔ a project may keep artifacts forever despite a server default (104.187839ms)
✔ a project setting overrides the server default (114.615253ms)
✔ an unfinished job is never swept (125.633157ms)
✔ logs older than the limit are removed but the task remains (112.46825ms)
✔ a swept log is distinguishable from one that never existed (98.400869ms)
✔ a log is swept only once (91.245025ms)
✔ zero keeps logs forever (110.916103ms)
✔ a storage failure leaves the row for the next pass (91.669259ms)
✔ a sweep deletes no more than its batch (125.484208ms)
✔ one project policy does not reach into another (115.426489ms)
✔ artifacts.expire in a pipeline reaches the stored artifact (246.399559ms)
﹣ the api reports and accepts project retention (0.324119ms) # the JSON API was removed
✔ seals and opens a value (8.59795ms)
✔ sealing twice produces different ciphertext (1.562392ms)
✔ without a key, values are stored as marked plaintext (0.68072ms)
✔ a keyed box can still read values written before a key existed (0.582376ms)
✔ an unkeyed box refuses encrypted values with an actionable message (2.381123ms)
✔ the wrong key fails to open (1.274776ms)
✔ tampering with the ciphertext is detected (1.673199ms)
✔ associated data binds a secret to its location (2.025284ms)
✔ a key of the wrong size is refused at construction (0.827574ms)
✔ task ids are opaque, and say nothing about their job (12.985051ms)
✔ time ordered ids sort by creation time (0.648051ms)
✔ random ids use the expected alphabet (0.509983ms)
✔ slugify produces readable project ids and falls back when empty (0.816172ms)
✔ token hashing and constant time comparison (2.406033ms)
✔ the pipeline this project jobs on itself compiles (72.09488ms)
✔ its tasks declare the features they actually need (17.522132ms)
✔ publishing is restricted to main and release tags (56.138063ms)
✔ get-vanilla matches the reference signature (4.931617ms)
✔ get-vanilla-query-order-key-case matches the reference signature (1.448944ms)
✔ uriEncode percent encodes the characters encodeURIComponent leaves alone (0.328711ms)
✔ amzDate produces both required formats (0.505797ms)
✔ s3 requests carry the content hash header (1.185142ms)
✔ presigned urls carry the signature in the query string (6.276513ms)
✔ an already encoded path is not encoded a second time (1.767063ms)
✔ key validation rejects traversal and absolute paths (6.47386ms)
✔ sanitizeRelativePath strips traversal from worker supplied paths (0.946427ms)
✔ key layout is stable (0.880509ms)
✔ local backend round trips a buffer and reports its digest (58.695084ms)
✔ local backend serves ranges (10.92065ms)
✔ local backend accepts a stream (16.147836ms)
✔ local backend reports a missing object and deletes idempotently (7.636526ms)
✔ local backend has no presigned urls (1.734269ms)
✔ a partial write leaves no object behind (4.999556ms)
✔ part size grows so that a huge object still fits in 10000 parts (1.21913ms)
✔ inParts regroups an awkwardly chunked stream into fixed parts (3.914647ms)
✔ inParts handles a chunk far larger than the part size (1.222482ms)
✔ inParts yields nothing for an empty stream (0.938585ms)
﹣ s3 backend round trips awkward keys against a real server (0.156516ms) # docker is not available
﹣ s3 serves byte ranges (0.141971ms) # docker is not available
﹣ s3 accepts a stream when the size is known (0.11619ms) # docker is not available
﹣ a presigned url is usable without credentials (0.254613ms) # docker is not available
﹣ a tampered presigned url is rejected by the server (0.172033ms) # docker is not available
﹣ s3 reports a missing object and deletes idempotently (0.139964ms) # docker is not available
﹣ a stream of unknown length is accepted (0.127297ms) # docker is not available
﹣ a body past the single request threshold is uploaded in parts (0.128505ms) # docker is not available
﹣ a large body really is sent as several parts, and a small one is not (0.125581ms) # docker is not available
﹣ a multipart object still serves ranges (0.124346ms) # docker is not available
﹣ a body that does not match its declared size is rejected (0.132405ms) # docker is not available
﹣ a failed multipart upload does not leave parts behind (0.121681ms) # docker is not available
﹣ bad credentials fail loudly rather than silently storing nothing (0.122151ms) # docker is not available
✔ every javascript file parses (975.568987ms)
✔ the shell scripts parse (2.641083ms)
✔ interpolated values are escaped by default (2.605774ms)
✔ quotes and ampersands are escaped inside attributes (0.445684ms)
✔ nested templates and arrays are kept, raw is passed through (0.428729ms)
✔ null, undefined and false render as nothing (0.348444ms)
✔ attrs omits absent values and renders bare booleans (0.517639ms)
✔ an anonymous visitor sees public jobs and an invitation to sign in (509.285431ms)
✔ an anonymous visitor cannot see a private job (291.813057ms)
✔ management pages redirect an anonymous visitor to sign in (215.12685ms)
✔ signing in through the form sets a session and reveals the nav (455.101557ms)
✔ a user creates a project through the form and is shown the secret once (351.589931ms)
✔ a project page shows variables and never their values (348.537146ms)
✔ setting and removing a variable returns the updated table (317.154083ms)
✔ a user cannot open or delete a project they do not own (493.422493ms)
✔ registering a worker shows the token once and lists it (346.115255ms)
✔ an ordinary user cannot create shared capacity from the form (528.2872ms)
✔ the users page is administrator only and warns about what deletion destroys (511.050093ms)
✔ a running job polls, and a finished one stops (424.168441ms)
✔ a task page streams the log and stops polling once it completes (334.756171ms)
✔ log output is escaped, so a task cannot inject markup into the page (378.044722ms)
✔ a mutation without the htmx header is refused (342.096614ms)
✔ the sign in form is centred rather than stranded at the left edge (181.731848ms)
✔ row actions stay ordinary table cells, so rows keep one height (355.639802ms)
✔ the stylesheet and htmx are served, and nothing else is (259.673344ms)
✔ the project page shows retention, with server defaults as placeholders (313.361023ms)
✔ saving retention through the form stores it, and empty means inherit (308.10623ms)
✔ a negative retention value is refused by the form (311.916167ms)
✔ the project page offers a working directory, defaulting to the server one (317.475861ms)
✔ saving a working directory stores it, and empty clears it (337.9486ms)
✔ an unusable working directory is refused by the form (379.772074ms)
✔ worker config loads from json and reports features (27.800376ms)
✔ worker config reads the token from a file (4.328508ms)
✔ environment overrides the worker config file (4.225859ms)
✔ worker config without a token is rejected (5.583015ms)
✔ a malformed feature is reported with its path (4.950491ms)
✔ shell quoting survives quotes and metacharacters (0.808097ms)
✔ a generated script echoes each command and stops on failure (1.007538ms)
✔ container names are valid for docker and stay unique (3.053723ms)
✔ job arguments carry mounts, env, network and privilege (1.98945ms)
✔ a task container is created without sharing anything with the worker (1.270417ms)
✔ a feature still contributes its bind mounts (0.54176ms)
✔ features resolve into mounts, env and privilege (1.326671ms)
✔ an unknown required feature is reported rather than ignored (0.308439ms)
✔ an artifact pattern reduces to the part that can be copied out (0.715481ms)
✔ overlapping artifact paths are copied out once (0.899843ms)
✔ artifact collection globs, and refuses to leave the workspace (36.418503ms)
✔ artifact when controls collection (0.37327ms)
✔ an idle worker keeps running instead of exiting (4011.686073ms)
✔ a worker stops promptly on a signal rather than after its poll interval (1520.052423ms)
✔ log output is batched and offsets advance (2.752873ms)
✔ a conflicting offset resynchronises instead of duplicating (0.80909ms)
✔ secrets are masked before anything leaves the host (1.281919ms)
✔ a secret split across two writes is still masked (0.529799ms)
✔ a failing conductor does not break the task (0.92829ms)
ℹ tests 331
ℹ suites 0
ℹ pass 295
ℹ fail 0
ℹ cancelled 0
ℹ skipped 36
ℹ todo 0
ℹ duration_ms 15308.397849
[conductor] done