Senior Full-Stack Engineer

About the Role

We are looking for a Senior Full-Stack Engineer to own and evolve our enterprise data

governance and cataloging platform. This is a high-impact role where you will work across

the full stack: a FastAPI/Python backend, Celery async workers, and a constellation of internal

microservices. You will be responsible for building features, debugging production issues

end-to-end, and ensuring platform reliability.

Key Responsibilities

• Design, develop, and maintain backend APIs using FastAPI, SQLAlchemy, and Pydantic
• Build and enhance frontend features in React and TypeScript (Redux, React Flow for lineage visualization)
• Develop and maintain Celery async tasks (Elasticsearch sync, query execution, lineage creation, metastore updates)
• Integrate with external services: Trino (SQL engine), Elasticsearch (search), Hive Metastore (metadata), Vault(secrets), Keycloak/OAuth2 (auth), and internal microservices
• Debug complex cross-layer issues spanning API routes, ORM relationships, SQL parsing, frontend state management, and Docker containers
• Write and maintain database migrations using Alembic
• Manage Docker-based local development and contribute to CI/CD pipeline improvements
• Ensure code quality through linting, testing, and code review

Required Skills and Experience

Backend (Primary Focus)

• 5+ years with Python (3.10+), strong grasp of async patterns, ORM pitfalls, and debugging
• Hands-on experience with FastAPI (route design, middleware, dependency injection, Pydantic models)
• Deep experience with SQLAlchemy ORM
• Working knowledge of Celery (task design, debouncing, beat scheduling, worker debugging)
• Familiarity with Trino/Presto SQL dialect Data & Infrastructure
• Experience with PostgreSQL (queries, indexing, migrations)
• Working knowledge of Elasticsearch (index management, document sync, search queries)
• Experience with Docker and Docker Compose for local development and debugging (container logs, exec, restart workflows)
• Familiarity with Redis as a message broker and cache
• Exposure to Hive Metastore or similar catalog systems is a plus

Nice to Have

• Experience with data governance or data catalog platforms (Apache Atlas, DataHub, Amundsen, Collibra, or similar)
• Knowledge of Apache Iceberg table format and its catalog integration
• Experience with Spark job submission via Kubernetes
• Familiarity with Apache Arrow / Flight for high-performance data transfer
• Experience with DBT and artifact management
• Understanding of data classification and access policy frameworks
• Experience with LDAP / Active Directory integration
• Familiarity with Nginx reverse proxy configuration