Location: Greenville, SC
Company: Rose International
Description Only those lawfully authorized to work in the designated country associated with the position will be considered. Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client s business needs and requirements.
Cloud Data Engineer Location : Greenville, SC 29607 United States Work Model : Onsite Hours : 8:00-5:00pm M-F Travel : Less than 5% Position Summary: Provides complete application lifecycle development, deployment, and operations support for large-scale batch and real-time data processing pipelines using cloud technologies. Collaborates with product owners, data scientists, business analysts and software
engineers to design and build solutions to ingest, transform, store, and export data in a cloud environment while maintaining security, scalability, and personal data protection.
Licenses and/or Certifications: AWS/Azure cloud provider training/certifications (preferred) Education: BA/BS Degree in Business, Computer Science or Electrical Engineering preferred or the equivalent of 4 years professional IT related experience. MS degree (preferred). Experience (Required and Preferred): 3+ years of enterprise software engineering experience with object-oriented design, coding and testing patterns, as well as experience in engineering (commercial or open source) software platforms and large-scale
data infrastructure solutions. 3+ years of software engineering and architecture experience within a cloud environment (Azure, AWS) 3+ years of enterprise data engineering experience within any " Big Data" environment (preferred) 3+ years of software development experience using Python 2+ years of experience working in an Agile environment (Scrum, Lean or Kanban) 3+ years of experience working in large-scale data integration and analytics projects, including using cloud (e.
g. AWS Redshift, S3, EC2, Glue, Kinesis, EMR) and data-orchestration (e. g. Oozie, Apache Airflow) technologies 3+ years of experience in implementing distributed data processing pipelines using Apache Spark 3+ years of experience in designing relational/No SQL databases and data warehouse solutions 2+ years of experience in writing and optimizing SQL queries in a business environment with large-scale, complex datasets 2+ years of Unix/Linux operating system knowledge (including shell programming) 1+ years of experience in automation/configuration management tools such as Terraform, Puppet or Chef 1+ years of experience in container development and management using Docker Languages: SQL, Python, Spark Basic knowledge of continuous integration tools (e.
g. Jenkins).
Basic knowledge of machine learning algorithms and data visualization tools such as Microsoft Power BI and Tableau Position Responsibilities/Accountabilities: Implements and enhances complex data processing pipelines with a focus on collecting, parsing, cleaning, managing and analyzing large data sets that produce valuable business insights and discoveries. Determines the required infrastructure, services, and software required to build advanced data ingestion & transformation pipelines and solutions in the cloud. Assists data scientists and data analysts with data preparation, exploration and analysis activities.
Applies problem solving experience and knowledge of advanced algorithms to build high-performance, parallel, and distributed solutions. Performs code and solution review activities and recommends enhancements that improve efficiency, performance, stability, and decreased support costs. Applies the latest Dev Ops and Agile methodologies to improve delivery time. Works with SCRUM teams in daily stand-up, providing progress updates on a frequent basis. Supports application, including incident and problem management. Performs debugging and triage of incident or problem and deployment of fix to restore services.
Documents requirements and configurations and clarifies ambiguous specs. Performs other duties as assigned by management. Benefits: For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website. California Pay Equity: For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here. Associated topics: data administrator, data analyst, data center, data manager, data quality, data scientist, data warehousing, database administrator, mongo database administrator, teradata
IT jobs refer to positions in the field of Information Technology, a sector dedicated to computing technology, telecommunications, and data management. These jobs typically involve the design, development, implementation, support, and management of computer-based information systems. Key characteristics of IT jobs include a focus on problem-solving, continual learning due to rapidly evolving technologies, and a blend of technical proficiency with soft skills like teamwork and communication. Roles can range from software developers and system analysts to network engineers and cyber security specialists, all contributing to the technological backbone of modern businesses.
IT jobs refer to employment within the field of information technology, an industry centered on the creation, maintenance, and support of computer systems and networks. Characteristically, these roles demand technical expertise in areas such as software development, cybersecurity, and data analysis. IT professionals are typically required to quickly adapt to new technologies and solve complex problems, often working in dynamic, fast-paced environments. The sector is known for its diverse career opportunities and has become essential across virtually all business sectors, reflecting the critical role technology plays in modern society.
IT jobs refer to positions in the Information Technology sector, which encompasses a vast array of roles focused on the creation, maintenance, and support of computer systems and networks. These roles include but are not limited to software development, systems analysis, network engineering, and cybersecurity. IT professionals often possess strong problem-solving skills, an aptitude for continuous learning due to the fast-paced evolution of technology, and the ability to adapt to new tools and practices. Their work is crucial for businesses as they ensure the efficient operation of digital infrastructures that support various organizational functions and safeguard data.
IT jobs refer to positions in the Information Technology sector, which encompasses a vast array of roles focused on the creation, maintenance, and support of computer systems and networks. These roles include but are not limited to software development, systems analysis, network engineering, and cybersecurity. IT professionals often possess strong problem-solving skills, an aptitude for continuous learning due to the fast-paced evolution of technology, and the ability to adapt to new tools and practices. Their work is crucial for businesses as they ensure the efficient operation of digital infrastructures that support various organizational functions and safeguard data.
