Hadoop Consultant
Company Name:
Valleysoft Inc
- Excellent knowledge of Hadoop architecture and administration and support
- Hands-on experience with the Hadoop stack (e.g. MapReduce, Sqoop, Pig, Hive, Hbase, Flume).
- Hands-on experience with related/complementary open source software platforms and languages (e.g. Java, Linux, Apache, Perl/Python/PHP, Chef).
- Design, develop, maintain cross-platform ETL processes and MapReduce/Hive data processing workflows
- Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture
- Underlying infrastructure for Big Data Solutions (Clustered/Distributed Computing, Storage, Data Center Networking)
- Experience with Hadoop Security model consisting of authentication, service level authorization, authentication for Web consoles and data confidentiality.
- Hand-on experience in leading and providing expertise and guidance to groups across the enterprise in the design and support of Hadoop security integration with Client LDAP
- 2 to 3 years applicable experience in developing and/or administering Hadoop (highly desirable BigInsights) production and development data hub environments in a large setting for complex systems.
- Experience in design, administration, implementation, upgrades, monitoring, change control, and performance tuning that ensures the application runs efficiently and reliably.
- Experience in providing technical support required to execute changes and enhancements as well as security consultation, design and implementation.
- Develop standards, guidelines, and QA processes to ensure highest data quality and integrity
- Drive Proof of Concept (POC) and Proof of Technology(POT) evaluation on interoperable technology platforms
- Train and mentor developers towards solution development and POC/POT execution
- Ability to work independently and as a team member
RESPONSIBILITIES
1. Lead role in designing, architecting ETL solutions, Data analysis, Dimensional Modeling and
ETL Design on assigned projects.
2. Evaluate and design Conceptual /Logical and Physical Data Models; define logical views and
physical data Security structures.
3. Lead the efforts to develop Informatica code, Design, Develop and modify, Informatica
mappings, workflows using all necessary Transformations as applicable.
4. ETL performance tunings, Optimization, Code Quality and Standards.
5. Adheres to BI documented Development Standards, Best Practices and Guidelines,
ensure compatibility, scalability, and integration with other data platforms.
6. Hadoop / BigInsights and the Netezza (Pure Data Analytics) Integration,
7. Off-Loading Netezza data into HDFS, Hbase/Hive. Constructing the Staging or the day zero archive in Hadoop.
8. Building the unstructured data Hub or the data lake in Big data platform for Analytics and then to feed to Datawarehouse.
9. Doing the Text Analytics, BigSheets, building BigSQL / Hive Queries
QUALIFICATIONS MINIMUM
1. 7
years of experience required in related field (i.e. ETL, Data Warehousing and SDLC);
2. 7
years of experience working with Informatica ETL tool (design and development).
3. 2
years of Big Data, Hadoop, BigInsights expertise
4. Strong data analysis skills, Dimensional Modeling, experiences in designing Star Schemas.
5. Strong in Big data Analytics and Netezza Admin work
6. Previous work experiences in large scale data integration and data warehouse solutions
database exceeding 10 TB.
7. RedHad Linux6.4, AutoSys
STRONG PLUSES
1. Expertise in Hadoop ecosystem products such as HDFS, MapReduce, Hive, Pig, Spark, AVRO, HBase, Zookeeper
2. Experience with SQL, Java (MapReduce), Python (linux shell like scripts) development
3. Experience of Business Intelligence, data mining techniques and analytics functions
4. Predictive analytics experience is a PLUSEstimated Salary: $20 to $28 per hour based on qualifications.
Valleysoft Inc
- Excellent knowledge of Hadoop architecture and administration and support
- Hands-on experience with the Hadoop stack (e.g. MapReduce, Sqoop, Pig, Hive, Hbase, Flume).
- Hands-on experience with related/complementary open source software platforms and languages (e.g. Java, Linux, Apache, Perl/Python/PHP, Chef).
- Design, develop, maintain cross-platform ETL processes and MapReduce/Hive data processing workflows
- Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture
- Underlying infrastructure for Big Data Solutions (Clustered/Distributed Computing, Storage, Data Center Networking)
- Experience with Hadoop Security model consisting of authentication, service level authorization, authentication for Web consoles and data confidentiality.
- Hand-on experience in leading and providing expertise and guidance to groups across the enterprise in the design and support of Hadoop security integration with Client LDAP
- 2 to 3 years applicable experience in developing and/or administering Hadoop (highly desirable BigInsights) production and development data hub environments in a large setting for complex systems.
- Experience in design, administration, implementation, upgrades, monitoring, change control, and performance tuning that ensures the application runs efficiently and reliably.
- Experience in providing technical support required to execute changes and enhancements as well as security consultation, design and implementation.
- Develop standards, guidelines, and QA processes to ensure highest data quality and integrity
- Drive Proof of Concept (POC) and Proof of Technology(POT) evaluation on interoperable technology platforms
- Train and mentor developers towards solution development and POC/POT execution
- Ability to work independently and as a team member
RESPONSIBILITIES
1. Lead role in designing, architecting ETL solutions, Data analysis, Dimensional Modeling and
ETL Design on assigned projects.
2. Evaluate and design Conceptual /Logical and Physical Data Models; define logical views and
physical data Security structures.
3. Lead the efforts to develop Informatica code, Design, Develop and modify, Informatica
mappings, workflows using all necessary Transformations as applicable.
4. ETL performance tunings, Optimization, Code Quality and Standards.
5. Adheres to BI documented Development Standards, Best Practices and Guidelines,
ensure compatibility, scalability, and integration with other data platforms.
6. Hadoop / BigInsights and the Netezza (Pure Data Analytics) Integration,
7. Off-Loading Netezza data into HDFS, Hbase/Hive. Constructing the Staging or the day zero archive in Hadoop.
8. Building the unstructured data Hub or the data lake in Big data platform for Analytics and then to feed to Datawarehouse.
9. Doing the Text Analytics, BigSheets, building BigSQL / Hive Queries
QUALIFICATIONS MINIMUM
1. 7
years of experience required in related field (i.e. ETL, Data Warehousing and SDLC);
2. 7
years of experience working with Informatica ETL tool (design and development).
3. 2
years of Big Data, Hadoop, BigInsights expertise
4. Strong data analysis skills, Dimensional Modeling, experiences in designing Star Schemas.
5. Strong in Big data Analytics and Netezza Admin work
6. Previous work experiences in large scale data integration and data warehouse solutions
database exceeding 10 TB.
7. RedHad Linux6.4, AutoSys
STRONG PLUSES
1. Expertise in Hadoop ecosystem products such as HDFS, MapReduce, Hive, Pig, Spark, AVRO, HBase, Zookeeper
2. Experience with SQL, Java (MapReduce), Python (linux shell like scripts) development
3. Experience of Business Intelligence, data mining techniques and analytics functions
4. Predictive analytics experience is a PLUSEstimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
