Data Engineer (AI & LLM Pipelines)
PT Vidavox Inovasi Digital
- Penuh waktu
- Hybrid • Jakarta Selatan
- Negotiable
Tidak Perlu Sign Up!
Deskripsi Pekerjaan
About Us
We are building an on-premise agentic LLM solution that enables businesses to run AI securely. Our stack includes LLMs, RAG, and multimodal AI, and we need a Data Engineer to help build robust data pipelines for AI model training, fine-tuning, and real-time data processing.
What You’ll Do
- Build & maintain ETL pipelines for structured & unstructured data.
- Develop AI-driven data ingestion pipelines (OCR, NLP, vector embeddings).
- Prepare datasets for fine-tuning LLMs and embedding models.
- Optimize data storage with vector databases (FAISS, Milvus, Pinecone).
- Work with streaming data for real-time AI applications (Kafka, Airflow).
- Ensure data integrity and compliance with security & privacy standards.
- Collaborate with ML engineers to enhance AI-driven solutions.
Tech Stack You’ll Work With
- Python, SQL
- PostgreSQL, MongoDB, Redis
- Apache Airflow, Prefect
- Apache Spark, Kafka
- OCR tools (Tesseract, AWS Textract, Google Vision)
- NLP Libraries (SpaCy, NLTK, Hugging Face)
- Vector DBs (FAISS, Milvus, Weaviate)
- Cloud platforms (AWS, GCP, Azure)
Kualifikasi
Requirements
- 3+ years of experience as a Data Engineer.
- Strong Python skills (Pandas, NumPy, PySpark).
- Hands-on experience with ETL pipelines, data lakes, and streaming data.
- Experience working with OCR, NLP, and vector databases.
- Familiarity with LLM fine-tuning, tokenization, and dataset preparation.
- Experience with cloud-based data solutions.
- Knowledge of security & compliance best practices.
Plus Points
- Experience fine-tuning LLaMA, GPT, or other transformer-based models.
- Working knowledge of Docker & Kubernetes.
- Background in cybersecurity or zero-trust architecture.
Why Join Us?
- Work on cutting-edge AI & LLM projects.
- Flexible hybrid work-culture
- Opportunity to define AI data infrastructure from the ground up.
- Growth opportunities in a fast-paced AI startup.
Tips Menjaga Diri
Perusahaan dan Lowongan di Dealls tidak meminta data pribadi, informasi rekening, atau pungutan ketika melamar. Hindari juga lowongan Google Form / Grup Telegram tanpa keabsahan yang jelas.
We are a Generative AI company specializing in on-premise large language model solutions that prioritize privacy, security, and customization. Backed by Antler and member of the NVIDIA Inception Program, we leverage cutting-edge technology to empower businesses with AI-driven innovations. Founded by industry veterans with extensive experience in AI research, product development, and market leadership, our team is passionate about delivering scalable, secure, and impactful solutions. From creating custom embedding models to generating high-quality synthetic data, we are committed to transforming how businesses leverage AI while maintaining full control over their data.
