Big Data Engineer

/Big Data Engineer

About the Job

Design and develop backend server-side components that drive our machine learning systems
Integrate and utilize big data technologies to support massive scalability, reliability and performance.
Define and implement requirements for predictive control and forecasting applications
Benchmark and debug critical algorithm and software issues
Work closely with product management, data science and QA teams to manage the full software lifecycle including requirements, architecture, algorithmics and QA
Assist DevOps in troubleshooting product issues in production and demo systems
Lead and mentor junior developers
About Company

We organize the world’s energy data using Internet scale, secure cloud-computing to process the petabytes of information produced from an increasingly networked and automated electricity grid. Weemploy Big Data analytics to generate real-time predictions and implement programs for electricity generators, providers, grid operators, and their customers to optimize utilization of assets across the grid and manage costs through a comprehensive Energy Data Platform (EDP)™

About You

Working knowledge of Python language and frameworks.  Must have experience working with Python in a production system (not just ad-hoc scripting)
Working experience in messaging frameworks and event driven systems
Deep understanding and experience of Big Data / NoSQL frameworks, Spark, HBase, Hadoop / MapReduce, HDFS, etc.
Hands-on experience in building, capacity planning, performance tuning and monitoring of Big Data environments
Solid understanding of algorithms, data structures, performance optimization techniques, best practices, and software design
Experience in RDBMS, Linux/Unix technologies
Sound knowledge of relational databases (SQL) and experience with large SQL based systems.
Experience with: Git, MySQL, Server side caching (Redis), and Amazon web services or equivalent cloud service
Experience in designing and developing large scale, distributed enterprise business solutions
BS, MS, or Ph.D. in computer science or related field
Excellent communication skills, self-motivation, persistence, energy, and focus
Experience with Agile / SCRUM methodology for product development
Nice to Have

Working experience with the following python frameworks: Celery, Django
Experience with messaging frameworks:  RabbitMQ, Kafka
Experience leading an offshore team to work with US onshore team
Experience implementing and deploying machine learning algorithms in production
Benefits and Perks

Collaborative, close-knit environment in Redwood Shores
Working with a really smart and fun group of people on solving BIG problems for a GIGANTIC industry
Competitive salary with equity
Medical, dental, vision insurance (PPO, HMO options)
401(k) and Flexible Spending Accounts
Brand new Macbook Pro, dual monitors and all the development tools that you want
Flexible hours
Easy parking
Catered team lunch everyday
H-1B visa transfers welcome

Upload your CV/resume or any other relevant file. Max. file size: 256 MB.

2017-09-21T04:59:13+00:00By |