Python Developer

The position is to work as a python developer in the Digitisation and ICT Infrastructure for Cultural Sector Preservation and Access initiative, a digital preservation project working across several state government departments.

The main duties for the Python Developer (ETL) position include:

• Migration of information packages containing files and metadata from a legacy application to the new DRF platform.
• Transforming from one information package specification to another.
• Working with Subject Matter Experts (SMEs) on mappings. Mappings can be quite complex with some variation in mappings based on metadata and logic.
• Performing iterations of migrations until SMEs are satisfied with the results in the target system.
• Once the mappings are stable, working with the wider development team to integrate with the new platform and build out a scaled-up pipeline for bulk migration.
• Setting up logging and reporting for tracking the migration of all information packages.
• Building a retry mechanism for reprocessing failed packages after manual correction.
• Overseeing and monitoring the data migration.
• Documenting the migration process so other staff can manage, monitor and complete the data migration.

Knowledge, skills and experience

• Python 5 years.
• ETL for data migrations between applications.
• APIs (SOAP and REST), XML and JSON.
• SQL.
• Git VCS, experience with GitHub preferred.
• Agile software development.
• JIRA and Confluence.
• Comfortable in a Linux development environment.
• Experience with AWS preferred.
• Well-developed analysis and problem-solving skills.
• Strong verbal and written communication skills.