Senior Data Architect and Data Engineer

Company: Pacific Life
Location: Aliso Viejo
Posted on: January 12, 2021

Job Description:

JOB DESCRIPTION: As a Senior Data Architect and Data Engineer, youll play a key role in Pacific Lifes digital and workplace transformation by working directly with the Advanced Analytics and Data Management teams to deliver data products in a collaborative and high-impact environment. Youll architect overall solution which is aligned to overall strategy. Youll then design, build, and maintain processes and components of a data pipeline to support analytics across LID, focusing on data quality and governance, pipeline performance, and best practices for democratized data access. If youre an expert in data architecture, data engineering, traditional data warehousing, ETL and/or big data pipeline and processing, youre exactly who were seeking. Technical capabilities aside, if youre a self-starter whos comfortable with ambiguity, able to think big without overlooking minute details, and who thrives in a fast-paced environment, youre perfect for our team. WHAT YOULL DO * Develop compelling Proof of Concept and/or Proof of Technology for data solutions using emerging technologies for real-time and big data ingestion and processing. * Design, build, and maintain processes and components of a streaming data/ETL pipeline to support real-time analytics (from requirements to data transformation, data modeling, metric definition, reporting, etc.) * Focus on data quality-detect data/analytics quality issues all the way down to root cause, and implement fixes and data audits to prevent/capture such issues * Collaborate with data scientists and analysts from multiple business domains to design and develop processes to further business unit and company-wide data science initiatives on a common data platform * Align with the systems engineering team to propose and deploy new hardware and software environments required and expand existing environments * Diligently team with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability * You may manage small vendor teams comprising of onsite-offshore to build solutions. TECH & TOOLS YOULL USE AWS infrastructure (EC2, EMR, Docker, Kubernetes etc.) Python SQL, Data processing technologies (Spark, Storm, Kafka, Flume, Pig, Hive, Sqoop, Hadoop/MapReduce), Data warehouses (Snowflake) Databases (SQL server/Oracle) NoSQL databases (Cassandra, HBase, Mongo) Control M FACTORS FOR SUCCESS * 8+ years of data engineering experience in data architecture, traditional data warehousing, ETL and/or big data pipeline & processing environments * Experience working with AWS environment * Strong data modeling and SQL experience * Strong programming experience with Python * Experience in containerizing applications * Experience with big data processing technologies (Spark, Storm, Kafka, Flume, Pig, Hive, Sqoop, Hadoop/MapReduce, etc.) * Experience with columnar storage and massive parallel processing data warehouses (Greenplum, Snowflake, Redshift preferred) * Hands on experience with building CI/CD (Continuous Integration/Continuous Deployment) * Exposure modeling and querying for NoSQL databases (Cassandra, HBase, Mongo) * Experience working within agile software engineering methodologies * Having Python/snowflake/AWS CSAA certification is plus. HOW WE HELP YOU SUCCEED: Were fostering a culture of shared values across our company by providing generous compensation and comprehensive benefits that allow our employees to find fulfillment and security in personal life and career alike. These include: * Competitive Salary and Benefits * Work-Life Balance & Flexible Scheduling * Medical, dental, and vision as part our commitment to investing in the health and wellbeing of our employees * Two retirement savings plans: 401k savings plan with company match and Company Retirement Contribution (company-paid) * Generous PTO and holiday pay * Warm Colleagues & Inspiring Culture EEO STATEMENT: _Pacific Life Insurance Company is an Equal Opportunity /Affirmative Action Employer, M/F/D/V. If you are a qualified individual with a disability or a disabled veteran, you have the right to request an accommodation if you are unable or limited in your ability to use or access our career center as a result of your disability. To request an accommodation, contact a Human Resources Representative at Pacific Life Insurance Company._

Keywords: Pacific Life, Aliso Viejo , Senior Data Architect and Data Engineer, Other , Aliso Viejo, California