Declare pipelines
Declare pipelines once, inducktail.toml at the root of the project repository. Each [[pipeline]] has a name, a kind, and the streams it writes.
ducktail.toml
Set
connection = "<slot>" on a pipeline to use a Tilde connection. The pipeline then gets the account’s current credentials, and refreshed OAuth tokens, from Tilde. A webhook pipeline with a connection receives that provider’s verified webhooks. Every slot a pipeline names must be declared in the ontology. See Connection slots.
Write any other secret as ${NAME}, and set it on the environment. See Secrets.
Connection slots
A connection slot is a third-party account the project needs. Declare it in the ontology, and bind it to a connection in each environment.ontology/connections.ts
ontology({ connections: [linear, github, slack] }). Handlers use the same slots to call the provider. See Call third parties.
Custom streams
A custom stream takes records from your own code. Each record is validated against a zod schema, and keyed, so a newer record of a key replaces the older one.ontology/sources.ts
ontology({ streams: [feedback] }), and write records with the management API. Use a management API key with write_streams on the project. At most 500 records go in one request.
Reference data
A stream can also ship static records with the project, such as configuration or lookup tables. Tilde validates them at build time, and loads them on every deploy. A redeploy replaces changed records. A record you remove from the list is not deleted.Tilde chat events
An ontology can read your organisation’s own Tilde data: chat threads, messages, participants, channel identities, runs, and inference usage. Declare atilde webhook pipeline with the streams you want. Message bodies reach the ontology only if you list public_chat_messages.
ducktail.toml
Models
A model is SQL over sources or other models, in dbt’s vocabulary. Read sources withsource(pipeline, stream), or use a custom stream directly.
ontology/models.ts
You can also keep SQL in a file with
sql: sqlFile("./customers.sql"), using {{ ref('model') }}, {{ src('pipeline', 'stream') }}, and {% if is_incremental() %}.
Models read upstream tables only through ref, src, and changes, so Tilde always knows a model’s dependencies. The build rejects SQL that names a raw table directly.
SQL dialect
Models and handler SQL use DuckDB’s SQL dialect. JSON payloads read with->>, including paths such as payload->>'$.address.country'.
Ontologies can also use PostgreSQL storage, with
storage: "postgres" in ontology(). All SQL is then PostgreSQL, and models can declare indexes. An environment runs only ontologies of its own storage, so talk to us before you switch.When a deploy rebuilds a model
Some changes make a deployed model rebuild from scratch: new inputs tochanges(), a new schema, or a new dependency. A deploy that would rebuild a model is refused, and names each model. Deploy again with --accept-rebuild model:<name> when the rebuild is what you want. See Deploy.