Purpose: |
|
IT Data Architects build and manage the data pipelines necessary to support value creation, growth, and delivery of IT results through designing and implementing the data and analysis infrastructure. This position optimizes data pipelines and moves data pipelines effectively into production for key data and analytics consumers by working across the City and with IT and other subject matter experts to plan and deliver optimal analytics and data solutions to users. |
Duties, Functions and Responsibilities: |
|
Essential duties and functions, pursuant to the Americans with Disabilities Act, may include the following. Other related duties may be assigned.
- Assists in building and managing the data pipelines necessary to support value creation, growth, and delivery of business and IT results.
- Designs and implements the data and analysis infrastructure, including complex databases.
- Assists in developing different technical tools/services to enable large scale machine learning solutions.
- Works closely with Data Analysts, and others to develop scalable and production ready Advanced Analytics and supporting software.
- Assists in building and maintaining data management systems and data pipelines that combine core data sources into data warehouses or other accessible
- structures to support reporting and analytical systems.
- Documents models, solutions, and implementations (e.g., Data Mapping, Technical Specifications, Production Support, Data Dictionaries, Test Cases, etc.).
- Creates data transformation processes (ETL, SQL stored procedures, etc.) to support moderately complex to complex business systems and operational data flows.
|
Responsibilities - Supervisor and/or Leadership Exercised: |
|
May provide leadership, work assignments, evaluation, training, and guidance to others
|
Knowledge, Skills, and Abilities: |
|
Must possess required knowledge, skills, abilities, and experience and be able to explain and demonstrate, with or without reasonable accommodations, that the essential functions of the job can be performed.
- Knowledge of languages such as (R, Pearl, Python, Java, C++, C#, Scala etc.), modern data storage and access technologies, including caching, application of NoSQL, Key/Value, and RDBMS datastores.
- Knowledge of commercial data science platforms (e.g., Python, R, KNIME, Alteryx, etc.).
- Knowledge of Extract-Transform-Load (ETL) processing and Change Data Capture (CDC) technologies.
- Knowledge of big data concepts and frameworks and business intelligence tools (such as Tableau, Qlik, PowerBI) and AI frameworks (Caffe, TensorFlow)
- Knowledge of Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance,
- Metadata Management.
- Knowledge of data pipeline guiding principles, and best practices to build and maintain data pipelines.
- Skill in data storage, data processing, database fundamentals, data orchestration and automation, programming, CI/CD, data validation and testing, version control systems, scripting and coding, cloud migration, metadata management, infrastructure as a code (IAC), data monitoring and observability skills.
- Ability to build, manage and optimize data pipelines that facilitate data movement.
- Ability to reduce manual data work and improve productivity.
- Ability to build robust data operations and to identify critical issues faster in order to debug and troubleshoot quickly.
- Ability to work with and across teams and foster a cooperative and efficient working environment.
- Ability to consider and incorporate the implications of analysis into recommendations for business decisions.
- Ability to turn data insights into recommendations for both clients and internal stakeholders based on context.
- Ability to adhere to required compliance to all change management policies and procedures.
- Ability to adhere to required compliance to all information security policies and procedures.
|
Minimum Qualifications: |
|
- Graduation with a Bachelor’s degree from an accredited college or university with major coursework in Information Science or in a field related to the job, plus five (5) years related experience.
- Masters degree may substitute for experience up to two (2) years.
- Education or experience may substitute up to four (4) years.
|
Licenses and Certifications Required: |
|
None.
|