Skip to main content

​
Jobs datasource specification

This page describes the file-based datasource specification for syncing Jobs and their Vacancies into TechWolf when no standardized connector (such as Workday or SAP SuccessFactors) is available. It defines the files TechWolf expects, the fields within each file, and which fields are required. Use this specification when a customer exports Job data from any source system to flat files. As long as the data can be shaped into the files below, TechWolf can ingest it. Jobs are referenced by Employees: the Employee Baseline points to a Job through assigned_position, and Internal Work History points to a Job through job_id (see the Employees specification). A Job referenced there must be synced through the Job Information file below. For the broader picture of how file-based integrations work and how they compare to API-based connectors, see Key concepts.

​
Technical data flow

Files are delivered to TechWolf over SFTP and land in an AWS S3 bucket, from where the file-based integration ingests them.
  1. The customer (or their source system) exports the Job files described below to a customer-hosted SFTP server.
  2. TechWolf connects to that SFTP server, pulls the files, and writes them to the customer’s S3 bucket under the file-based ingest prefix.
  3. The file-based integration reads the files from S3 and syncs the data into the TechWolf SkillEngine API.
To configure the SFTP server and the folder mappings TechWolf pulls from, see Self-service SFTP setup. For the S3 layout and naming conventions, see File Organization. Each file has a fixed location and naming pattern on S3. The base path is:
During the testing phase, the staging environment path is used instead: s3://techwolf-<customer>/staging/external/input/integrations/file_based/.

​
Reading the field tables

Each field is annotated in the Key column to indicate its role:
  • Primary key — the external ID of the file; uniquely identifies the entity.
  • Foreign key — references the primary key of another entity, linking the two.
Fields without a Key annotation are TechWolf data fields used for skill inference or context, not identifiers.

​
Job Information

The baseline Job file. Required. Contains the Jobs (and their architecture hierarchy) that TechWolf infers skills for. File on S3: .../file_based/TechWolf_Job_Information/TechWolf_Job_Information_[yyyy][MM][dd]_[HH][mm][ss].csv

​
Job Vacancies

Open Vacancies (Job Requisitions) linked to Jobs. Highly recommended. Vacancy text is a strong signal for skill inference. File on S3: .../file_based/TechWolf_Job_Requisition/TechWolf_Job_Requisition_[yyyy][MM][dd]_[HH][mm][ss].csv