Job Description

Verified Job On Employer Career Site

Job Summary:

The University of California, Merced is a cutting-edge research institution seeking an experienced Data Engineer to join their Data Services team. This role involves managing data extraction, loading, and transformation processes while optimizing the operational data store and cloud-based data warehouse.

Responsibilities:

• Design, develop, and maintain ETL/ELT processes to efficiently extract data from various sources, transform it to meet business requirements, and load it into data warehouses or data stores.

• Collaborate with data analysts, business users, and other stakeholders to understand data integration needs and requirements.

• Optimize ETL/ELT workflows to improve data quality, accuracy, and efficiency.

• Monitor and troubleshoot ETL/ELT jobs to ensure data integrity and consistency.

• Act as a subject matter expert in ETL/ELT and database architecture, offering guidance and mentorship to junior team members.

• Design, implement, and maintain database architectures that align with the organization's data strategy and business goals.

• Perform capacity planning, scalability assessments, and database performance tuning to ensure optimal database operations.

• Evaluate and recommend database technologies, tools, and platforms to support evolving data needs.

• Develop and maintain data models, schema designs, and data dictionaries for various databases.

• Document database architecture, ETL/ELT processes, and data flow diagrams for knowledge sharing and compliance purposes.

• Develops and supports data integrations between on-premises and cloud-based data platforms to destination applications.

• Ensures that data is delivered accurately and timely to downstream platforms supporting institutional operations.

• Develops and maintains moderately complex data models, schema designs, and data dictionaries for shared data models and integrations.

• Documents design, mappings, and data flow diagrams for knowledge sharing and compliance purposes.

• Partners with DBAs for schema design, indexing, and database performance optimization.

• Collaborates with Analytics Engineers to prepare analysis-ready datasets.

• Works with BI Analysts to ensure data availability for dashboards and operational reporting.

• Coordinates with external partners and functional units to articulate technical requirements.

• Ensure compliance with data privacy regulations (e.g. FERPA, IS3) by developing and enforcing data protection policies.

• Collaborate with legal and compliance teams to manage data access permissions, masking, and encryption.

• Establish and administer on-premises and cloud-based database security, role-based access control (RBAC), managing load operations, performance, computing and storage management, data replication and data sharing.

• Establishes and maintains automated data quality checks, metadata capture, and data catalog contributions.

• Documents data pipelines, mappings, and workflow logic.

• Participates in campuswide data governance and stewardship efforts.

• Explores new technologies, proposes automation opportunities, and contributes to architectural decisions to modernize the university’s data ecosystem.

Qualifications:

Required:

• Bachelor's degree Computer Science, Computing Engineering, Information Technology, Information Systems, or related field from an accredited institution

• Five years of progressively increasing responsibility and technical ability

• Solid working knowledge of advanced analytics and business intelligence concepts such as data analysis, ETL, data warehousing, data lake, enterprise big data platforms, reporting, visualization and dashboards.

• Proven experience as an ETL/ELT Developer and Database Architect with a track record of successful project implementations.

• Strong SQL skills and experience working with structured and semi-structured data formats (e.g., JSON, Parquet, CSV).

• Proficiency in modern data ingestion tools such as Informatica, Fivetran, or similar tools.

• Proficiency with python or similar languages to develop custom ingestion pipelines.

• Proficiency in modern ETL/ELT tools such as Informatica, DataStage, Databricks, dbt, or similar tools.

• Proficiency in modern data integration tools and/or Reverse ETL tools such as Mulesoft, Census, Hightouch, or similar tools.

• Proficiency in API implementation and management.

• Familiarity with data modeling concepts including dimensional modeling, star/snowflake schemas, and normalization.

• Familiarity with data quality best practices, documentation standards, and data governance frameworks.

• Demonstrated ability to work with others from diverse backgrounds.

• Demonstrated effective communication and interpersonal skills.

• Demonstrated service orientation skills.

• Strong communication, documentation and interpersonal skills including demonstrated ability to communicate technical information to technical and non-technical personnel at various levels in the organization.

• Excellent problem-solving skills and the ability to troubleshoot complex data issues.

• Strong analytical and design skills, including the ability to abstract information requirements from real-world processes to understand information flows in computer systems.

• Knowledge of data warehousing concepts and best practices.

• Thorough knowledge of data warehouse design, including managing schema objects (tables, indexes, and materialized views), creating reports based on the data in the data warehouse, monitoring the data warehouse's performance and taking preventive or corrective action as required.

• Demonstrated ability to build and manage data pipelines across on-prem and cloud environments, integrating data from multiple source systems.

• Partnering with all levels of an organization, including senior leadership, management, technical IT staff, business leaders, data stewards, and end users.

• At least 5 years experience in data modeling, ELT/ETL, and cloud data platforms.

• Demonstrated Linux skills including security management, user management, process management, troubleshooting and debugging.

• Proficient in developing and managing automation, data processing, scripting, and navigating the file system.

• Working knowledge of Oracle Data Integrator (ODI) including agent management, repository upgrades, job design, and error resolution.

• Proficient with PL/SQL including writing efficient queries, designing database structures, and implementing stored procedures, functions, and triggers.

• Proficient in optimizing performance and error handling.

• Experience with DevOps or CI/CD tools for data pipeline development and deployment.

• Experience developing custom AWS Lambda functions for ingesting data.

Preferred:

• Advanced degree in a related field from an accredited institution

• Relevant certifications (e.g., AWS Certified Data Analytics, Microsoft Certified: Azure Data Engineer, Snowflake: SnowPro Core Certification ) are advantageous.

• Previous experience with higher education and ERP software systems such as Banner, PeopleSoft, or similar ERP systems.

Company:

University of California system and the first American research university of the 21st century. Founded in 2005, the company is headquartered in Merced, California, USA, with a team of 1001-5000 employees. The company is currently Late Stage.

Job Tags

Similar Jobs