Big Data Engineer

APR Consulting • Full-time • Rosemead, CA, Los Angeles County, CA, US • $124.80k / year • 3d ago

Big Data Engineer Location: Rosemead , California Type: Contract Job 78718 An electric utility client is looking for a Big Data Engineer who is responsible for developing and maintaining data ingestion and consumption pipelines for Palantir, deriving data insights using platform capabilities towards the realization of analytics and data science use cases. Location: Rosemead, CA 91770 (Hybrid) Position: Big Data Engineer Pay Rate : $60/hr. on W2 (Negotiable) Duration : 18 months or longer Schedule: M-F (8 am to 5 pm) with scheduled availability during non-working hours, weekends during PSPS activations (typically 4-5 instances of 2-5 days in a year) This is Hybrid - 2 days (Tue and Wed) RESPONSIBILITIES: The job function includes understanding of business requirements, defining data requirements, identifying enterprise data sources, planning, designing, and building data acquisition from sources, defining data model, taxonomy, designing data ingestion pipelines, data normalization, data transformation, and consumption using Palantir. The position is responsible for developing and maintaining data ingestion and consumption pipelines for Palantir, deriving data insights using platform capabilities towards the realization of analytics and data science use cases. The job function includes developing data insights, data mining, and support for AI/ML use cases training and deployment within the company's analytics landscape, specifically within Palantir platform. Specifically, the job involves: Manage PSPS activations - on call during activations fielding and managing communications, logging tickets, communicating and monitoring different channels Development of design artifacts to describe technical components of solutions for long term maintenance and support Development of comprehensive solutions using Palantir Prioritize and implement solution enhancements and support production issues Development of documentation for implemented solutions Participation in daily scrum style meetings Participation in sprint planning to provide estimates for assigned work Support of End-to-End testing with the company's Systems interfacing with solutions in Palantir platform SOFT SKILLS: Proficiency with Palantir Foundry Data Integration: Experience with integrating data from multiple sources into Palantir Foundry, including ETL processes and data transformation. Foundry's Code Workbooks: Proficiency in using Foundry's Code Workbooks to write and execute Python, PySpark, or SQL scripts for data processing. Ontology Development: Ability to model and organize data into an ontology within Foundry, creating logical structures that make data easy to access and use. Pipeline Management: Experience in building, managing, and optimizing data pipelines in Foundry to ensure efficient data flow and processing. Palantir Data Governance and Security Data Lineage and Provenance: Understanding how to implement and utilize data lineage features within Palantir to track data origins, transformations, and usage. Access Control Management: Knowledge of setting up and managing data access controls within Palantir, ensuring compliance with data governance policies. Data Compliance: Experience ensuring data usage complies with organizational and regulatory requirements, leveraging Palantir's compliance tools. Data Analytics and Visualization Hands-on with Palantir's Visualization Tools: Proficiency in creating dashboards, reports, and other data visualizations using Palantir's in-built tools. Analytical Functions: Experience using Palantir's analytical functions to conduct complex data analysis, including statistical and predictive modeling. Collaboration and Workflow Automation Knowledge of Palantir's Collaborative Features: Familiarity with Palantir's collaboration features to work with cross-functional teams, share insights, and integrate feedback into data solutions. Workflow Automation: Ability to design and implement automated workflows within Palantir to streamline data processing tasks and ensure timely data delivery. Python, SQL, and Big Data Technologies Programming Skills: Proficiency in Python and SQL, essential for coding custom data processing tasks within Palantir. Big Data Handling: Experience working with large datasets, including knowledge of distributed computing tools like Apache Spark, which can be integrated with Palantir Foundry. Experience with Industry-Specific Applications Domain Knowledge: Understanding of the electric utility data requirements Troubleshooting and Optimization Problem-Solving Skills: Strong problem-solving skills to troubleshoot and resolve issues that arise during data integration and analysis in Palantir. Optimization Techniques: Knowledge of optimizing data pipelines and analytical workflows to improve performance and reduce costs. REQUIRED QUALIFICATIONS: Bachelor's Degree in Information Technology or related specialized field or an equivalent combination of education, training, and experience. 5 years of experience in architecting and designing information, integration, and analytics solutions 3 years' experience in data engineering, data mining, large scale data acquisition, transformation, and cleaning both structured and unstructured data 2 year's experience developing solutions using Palantir technology, Python, Pyspark, SQL. 2 years of Palantir Foundry in-depth hands-on experience About our client : Our client is one of the largest electric utilities and a longtime leader in renewable energy and energy efficiency in the United States providing electricity for much of Southern California. About APR: Since 1980 APR Consulting, Inc. has provided professional recruiting and contingent workforce solutions to a diverse mix of clients, industries, and skill sets nationwide. Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. We are an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law. Don't miss out on this amazing opportunity If you feel your experience is the match for this position please apply today and join our team. We look forward to working with you SLA

Related Jobs

Environmental Health & Safety Manager

Malarkey Roofing Products • Full-time • South Gate, California, United States • $80k - $110k / year • 11h ago

Non-profit / Social Services

11h ago

Apply

Biologist & Project Manager

Environmental Science Associates • Full-time • Los Angeles, California, United States • $108.82k - $133.00k / year • 11h ago

Project Management

11h ago

Apply

Environmental Health & Safety Manager

Martin Brower • Full-time • Industry, California, United States • $80k - $120k / year • 3d ago

Non-profit / Social Services

3d ago

Apply

Area Service Manager- Energy Storage

Fluence • Full-time • Los Angeles, California, United States • $130k - $165k / year • 4d ago

4d ago

Apply

Seasonal Courtesy Clerk - Store 02 Part-Time

Northgate Gonzalez Markets, Inc. • Part-time • La Habra, CA, Orange County, CA, US • $30k - $40k / year • 5d ago

Retail / Consumer Products

5d ago

Apply

PROGRAM IMPLEMENTATION MANAGER, HEALTH SERVICES (Office of Environmental Justice)

County of Los Angeles, CA • Full-time • Los Angeles, California, United States • $141.91k - $220.69k / year • 6d ago

Project Management

6d ago

Apply

Environmental Project Manager - 4 years minimum experience

AECOM • Full-time • Los Angeles, California, United States • $80k - $120k / year • 6d ago

Project Management

6d ago

Apply

Media Services Section Manager

Metropolitan Water District of Southern California • Full-time • Los Angeles, CA, Los Angeles County, CA, US • $100k - $130k / year • 6d ago

6d ago

Apply

Residential Solar Supply Chain & Procurement Manager

Haven Energy • Full-time • Los Angeles, California, United States • $90k - $120k / year • 1w ago

Green Energy

1w ago

Apply

Case Manager - SOLAR

The People Concern • Full-time • Compton, California, United States • $48k / year • 1w ago

Green Energy

1w ago

Apply