Data Engineer

Holisticon Insight is a division of Nexer Group focused on IoT, AI, and advanced analytics. They assist customers in developing IoT services, portals, and mobile apps, and analyze data using AI and advanced analytics to reduce costs, streamline processes, and find new business opportunities. The company values competency growth, a dynamic company culture, flat structure, and self-organized teams.

• Advanced SQL and Python (Pandas, PySpark) skills.
• Deep experience building REST API connectors.
• Proven track record of designing data staging environments and managing complex data topologies.
• Experience handling fragmented, sparse datasets.
• Familiarity with biological or agricultural data schemas is a strong plus.

• Develop API and SQL-based connectors for diverse data sources and build automated ingestion scripts to centralize tables.
• Standardize raw data into a unified staging format, implement version control for raw datasets, and establish data lineage tracking from source to staging.
• Map data schemas across different tables to identify overlaps, quantify sparsity levels, and identify missingness patterns.
• Implement secure credential management for database access.