Ai Data Engineer (Xico)

Responsibilities

• Maintain and enhance ingestion/enrichment pipelines for internal content (parsing/extraction, normalization, metadata enrichment, deduplication, and quality monitoring)
• Improve indexing and retrieval performance and quality (chunking/segmentation refinements, embedding/index update workflows, metadata filtering, caching) and support hybrid retrieval capabilities (vector + keyword/BM25 + metadata)
• Implement and maintain access‑aware retrieval by propagating/enforcing document permissions through indexing and query‑time filters, including audit logs and validation tests
• Improve source attribution so responses reliably point to the correct documents and sections in a consistent format
• Extend and harden tool/workflow execution and automations (scheduled/trigger‑based), including retries, timeouts, idempotency, concurrency controls, and run history
• Develop and maintain evaluation and regression testing (golden...