SPIN Analytics and Strategy, LLC has an opening for a Sr. Data Engineer (Ref# SDE429MM) to work in Fremont, CA and various unanticipated locations throughout the U.S.
Responsible for each phase of the software development life-cycle (SDLC)including requirements analysis, design, development, implementation, testing, documentation,deployment, maintenance, and support of data warehouse / ETL applications.Analyze functional / technical requirements of the project. Interact with business analysts to understand the requirements and existing system.
Design and build big data solutions using Teradata / Hadoop from both structured and unstructured data sources. Build real-time streaming of information from messaging sources such as Kafka.Create ETL jobs using to load JSON and server data into HDFS, cloud, and Teradata warehouse systems. Create Python scripts to read and process data from API. Build analytics and visualization tools that utilize the data pipeline to provide actionable insights into customer operational efficiency and other key business performance metrics. Analyze and resolve technical data issues in the data mart, data warehouse, and reports. Design ER (entity relationship) diagrams, logical model, and physical database for Teradata as per business requirements using Erwin. Support analytics in model creations and testing.
Generate statistics/ad-hoc reports for business on various data marts for decision making, business analysis, and for implementing new business ideas. Write complex Hive/Spark SQL queries in Hadoop environment for data mining and business analysis. Deliver and drive projects by partnering with engineering, product, and business teams. Actively support the plan and organization of activities through JIRA tickets. Follow Scrum timelines and update the version stories as needed.
Organize meetings with the subject-matter experts of the dependent systems when changes are done for the existing system. Identify and resolve technical problems related to performance and functionality. Review project deliverables and ensure adherence to quality standards. Analyze the transaction data in case of any alerts and identify issues to implement necessary rules to avoid such in future.
Validate implementation and post-production support activities. Maintain developed code in GitHub for versioning. Monitor the daily job execution in production environment and fix it in case of any failures. Use of Teradata, Tableau, Automic Automation, Erwin, Informatica, Talend, Hadoop, HDFS, Hive, Spark, Kafka, Python, SQL, JIRA, GitHub, Oracle, MySQL, and UNIX. Travel and/or relocation required.
This position requires a Master’s degree or foreign academic equivalent in Computer Science, Computer Engineering, CIS, MIS, or a related field.
To apply, please MAIL resume to referenced address, ensuring to indicate the position reference code (Ref# SDE429MM) for which you are applying.
Mail to : SPIN Analytics and Strategy, LLC, Attn:Pavan Javaji, President, 4510 Peralta Blvd., Suite 24, Fremont, CA 94536.