Sr. Data Engineer (GenAI & AWS) Remote/Hybrid with Travel
Jacksonville, United States
The key is time zone coverage and so we can expand our search across the West Coast - remote/hybrid but necessarily located in the western time zones. You must be comfortable to travel to the client site for workshops/meetings.
Overall experience: 12-20+ years; Cloud Platform: AWS; Primary Language: Python
Key Responsibilities
- Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
- Build automated document-processing workflows for extracting, transforming, and processing structured and unstructured data.
- Implement document chunking, embeddings, vector indexing, and semantic search.
- Develop and maintain vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG).
- Integrate knowledge bases with AI agents for contextual information retrieval.
- Build AI agents using Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime.
- Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments.
- Optimize data pipelines for scalability, reliability, security, and performance.
Must-have vs. good-to-have skills
- Python, SQL
- TypeScript
- AWS Step Functions, Lambda, S3
- AWS Glue
- Amazon Textract and Comprehend
- Document AI / OCR
- Vector databases and embeddings
- Document chunking and indexing
- Advanced retrieval and reranking
- RAG and knowledge-base integration
- Amazon Bedrock
- GitHub Actions CI/CD
- Terraform / AWS CDK
- AWS IAM and API integrations
- AgentCore Runtime
Important: If this individual must personally build and deploy the Claude agents, move Claude Agent SDK and AgentCore Runtime into the must-have category.
#J-18808-Ljbffr