Position: Principal Enterprise Data Architect and Data Solution Architect

Location: Remote

Data Design Management

- Lead the strategy design, development, implementation, and maintenance
of complex data systems and solutions in the cloud
- Create and maintain current and target state cloud database, data
warehouse, data platform and big data architectures.
- Define and manage cloud data warehouse and big data technology
standards, guidelines, and processes to ensure data quality
- Consult with external industry leading cloud providers to ensure cloud
data warehouse and big data technology solutions are in alignment with data
architecture principles and target state
- Oversee end-to-end cloud data warehouse and big data life cycle
management activities
- Deploy and manage Redshift and other cloud scale data warehouses in
Amazon Web Services (AWS) cloud environment.
- Oversight data warehouse maintenance, optimization, and configuration
tuning in AWS cloud environments.
- Automate provisioning, operation, monitoring, and troubleshooting of
data warehouses in AWS cloud environment
- Perform Disaster Recovery (DR) planning and execution in accordance
with RPO/RTO and defined SLAs
- Own product data sets from the definition phase through to production
deployment.
- Build distributed, scalable, and reliable data pipelines that ingest
and process data at scale and in real-time.
- Provide solutions for the design and implementation of Data Lake
Cluster/ Big Data Infrastructure in AWS cloud environment.
- Deploy and maintain Big Data/Spark and database storage
Infrastructures in AWS cloud.
- Create data environments and/or data sets to serve a wide range of
data users, including but not limited to Data Scientists, Data Analysts,
Business Analysts etc
- Perform offline analysis of large data sets using components of a big
data software ecosystem.
- Support the evaluation of big data technologies and prototype
solutions to improve data processing architecture.
- Troubleshoot and determine root cause of complex data provenance,
metadata issues and engineering questions that may involve interfacing with
various technical staff in multiple organizations and with differing levels
of expertise.
- Investigate, evaluate, test and recommend technical solutions for
future systems.
- Develop tools and procedures to monitor and automate system tasks on
servers and clusters
- Architect and Author complex extract, transform and load (ETL) scripts
for moving and curating data into data sets for storage and use by a Data
Lake, data warehouse and Data Mart.

Technical Advisor

- Collaborate with other teams to design, develop, and deploy data tools
that support both operations and product use cases.
- Evaluate and advise on technical aspects of open work requests in the
product backlog with the project lead

Knowledge and Skills

- Knowledge of database concepts, object and data modeling techniques
and design principles
- Detailed knowledge of database architectures, software, and facilities
- Successful history of manipulating, processing, and extracting value
from large, disconnected data sets
- Experience with programming languages ? Python (required), Scala,
Ruby, R
- Database technologies - SQL, performance tuning concepts, AWS RDS,
RedShift, MySQL
- Experience with big data batch processing tools: Hadoop MapReduce,
Elasticsearch, PIG, Hive, Cascading/Scalding, Apache Spark, AWS EMR
- Experience with stream-processing systems: Kinesis, Kafka, MQTT
- Experience with relational NoSQL databases including DynamoDB
- Ability to write JSON, XML, YAML and other data definition schemas
- Good verbal and written communication skills necessary to effectively
collaborate in a team environment and present and explain technical
information and provide advice to management.
- Works on advanced complex technical projects or business issues
requiring state of the art technical knowledge or industry.
- Works on significant and unique issues where analysis of situations or
data requires an evaluation of intangibles. Exercises independent judgment
in methods, techniques and evaluation criteria for obtaining results.
- May be the in-house expert on specific technologies.
- Ability to provide a leadership role for the work group through
knowledge in area of specialization.
- Education:
- Bachelor?s degree in computer science, computer engineering, or a
related field, or the equivalent combination of education and related
experience.
- 12 years of professional experience as a data software engineer
- 2 years of experience with AWS cloud or other cloud Big Data computing
design, provisioning, and tuning.
- Related Data Analytics, AI/ML and Data Science AWS certification,
preferred







Reference : Data Architect - Remote jobs