Required Skills
About the Job
Forage AI is seeking a Senior Software Engineer to join our team. You will play a crucial role in designing, developing, and delivering our large-scale data collection and processing platforms. This is a hands-on role where you will actively contribute to development, potentially lead teams, and set technical direction. You'll be involved in architecture, development, and delivery, while also owning team execution, quality, and growth. Our primary language is Python, and we build cloud-native and cloud-agnostic solutions, primarily on AWS, with exposure to GCP and Azure.
**Key Responsibilities:** * End-to-end project ownership from requirements to operations. * Architect scalable, fault-tolerant systems for data processing. * Write production code in Python, setting standards through code reviews and design docs. * Mentor and grow engineers on design, coding, and operational excellence. * Collaborate with stakeholders to translate business needs into technical plans. * Establish and enforce engineering best practices (CI/CD, testing, security). * Drive adoption and effective usage of GenAI and AI-agent systems, including prompt engineering, agent design patterns, RAG pipelines, and evaluation techniques.
**Required Qualifications:** * 5-8 years of software engineering experience, with leadership experience. * Expert in Python; strong understanding of data structures, algorithms, concurrency, and distributed systems. * Deep experience with SQL and NoSQL databases (familiarity with vector databases is a plus). * Proven experience designing and deploying cloud-native systems on AWS. * Significant experience building and operating crawlers/parsers and robust ETL/ELT pipelines. * Hands-on GenAI and LLM experience (e.g., LangChain, CrewAI, LlamaIndex, prompt engineering, RAG pipelines). * Experience with CI/CD, Docker, and Kubernetes. * Proficiency with Git, testing strategies, observability, and performance tuning. * Excellent communication skills, with the ability to produce high-quality design documentation.
**Preferred Qualifications:** * Experience with Data Pipelines/Big Data technologies like Spark, Kafka, or Airflow. * Exposure to Infrastructure as Code (Terraform/CloudFormation). * Exposure to GCP/Azure. * Experience with interviewing and developing talent.
**Work-from-Home Requirements:** * High-speed internet, reliable computer (16GB+ RAM), quality headphones, and stable power.
Forage AI is an equal opportunity employer.