Collected data is only useful once it lands where your team works. Infovium delivers web data as files, through a REST API, over SFTP or FTP, into cloud storage or directly into a database, depending on what your systems need.
Available delivery methods
| Method | Details | Typical use | What we ask you |
|---|---|---|---|
| Files | CSV, Excel/XLS, XML, HTML, JSON, JSON Lines (JSONL) | Analysis, spreadsheets, imports, data pipelines | The format and the structure you need |
| REST API | Data delivered through a REST API | Applications that pull data on demand | How your application will call it and the response structure you need |
| SFTP and FTP | Files placed on a transfer server | Scheduled batch hand-offs | Which protocol and how often files should arrive |
| Cloud storage | Amazon S3, Cloudflare R2 and Google Cloud | Data lakes and warehouse loading | Which provider, and how your team will read the files |
| Direct database delivery | Records loaded into your database | Operational systems and reporting | The database type and the target table structure |
Delivery formats, schema, destination and frequency are agreed according to project requirements. Not every method is included in every project, and the right one is agreed in the written scope.
Choosing a format
| Format | Good for | Note |
|---|---|---|
| CSV | Analysts, quick imports, spreadsheets | Flat rows and columns. Encoding and delimiter are agreed per project |
| Excel/XLS | Business users who open files directly | Spreadsheet layout |
| JSON | Applications and APIs | Handles nested fields, such as a product with several variants |
| JSON Lines (JSONL) | Large datasets and pipelines, including AI and LLM data pipelines | One record per line, so files can be read record by record |
| XML and HTML | Systems that expect them | Available on request |
One-time and recurring delivery
Data can be delivered once or on a schedule. Supported collection frequencies are every few minutes, hourly, daily, weekly, monthly, or one-time and on-demand. Actual frequency depends on source characteristics, project feasibility and the requirements agreed with you. We do not promise minute-level collection for every website. For recurring feeds see managed data services.
Decisions to settle in the scope
- The delivery method and the target system.
- The schema: field names, types and the order of columns.
- The schedule: how often data is delivered.
- What each delivery contains. Incremental delivery of new or changed records can be supported where technically feasible and included in the agreed project scope. Not every source supports reliable change detection or incremental updates.
- How validation failures are handled, see data cleaning and validation.
Secure transfer
Files are delivered through secure file transfer or authenticated delivery. Specific transfer arrangements for your project are agreed in the scope.
How delivery is set up
- You tell us where the data should go and in what structure.
- We agree the schema, method and schedule in a written scope.
- Where a sample is provided, you can use it to test your import.
- Delivery then follows the agreed schedule.
Related services
Data delivery FAQ
Can you deliver straight into our database?
Direct database delivery is available. Share the database type and schema in your inquiry.
Do you offer an API?
REST API delivery is available where the project calls for it.
Can you send data to Amazon S3 or Google Cloud?
Yes, cloud storage delivery includes Amazon S3, Cloudflare R2 and Google Cloud.
Can I choose JSON instead of CSV?
Yes. JSON and JSON Lines are available alongside CSV, Excel/XLS, XML and HTML.
How often can data be delivered?
From one-time to monthly, and for suitable sources hourly or every few minutes, as agreed in scope.
Can you deliver only new or changed records?
Incremental delivery of new or changed records can be supported where technically feasible and included in the agreed project scope. It depends on the source and the project requirements.
Tell us where the data should go
Describe your target system and format and we will propose a delivery plan.