Data Engineer

Key Responsibilities:

Generative AI Development

Develop and implement generative AI models using frameworks like LangChain

or Llama-Index.

Apply prompt engineering techniques to design effective queries and ensure

optimal LLM responses for diverse use cases.

Master advanced LLM functionalities, including prompt optimization,

hyperparameter tuning, and response caching.

Implement Retrieval-Augmented Generation (RAG) workflows by integrating

vector databases like Pinecone, Weaviate, Supabase, or PGVector for efficient

similarity searches.

Work with embeddings and build solutions that leverage similarity search for

personalized query resolution.

Explore and process multimodal data, including image and video understanding

and generation.

Integrate observability tools for monitoring and evaluating LLM performance to

ensure system reliability.<...