Sqoop

lastmod 2021-05-28created 2020-09-162 edits

Sqoop is a command-line interface application for efficiently transferring bulk data between structured relational databases and Apache Hadoop.

See also

• Apache
• Sqoop
• Kafka - Apache Kafka is an open-source message broker project developed in Scala by the Apache Software Foundation. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.
• Hive - Apache Hive is a data warehouse infrastructure built on Hadoop that provides data summarization, query, and analysis. It was initially developed at Facebook, but is used and developed by companies such as Netflix.
• Hadoop - Apache Hadoop is a freeware Java software framework that supports distributed applications running on large computer clusters that can process huge amounts of data. It was originally developed to support distributed processing for Nutch, and is a subproject of Apache Lucene.
• Oozie - Apache Oozie is a server-based workflow scheduling system for managing Hadoop jobs. Oozie workflows can be parameterized using variables such as ${inputDir} in the workflow definition. When submitting a workflow job, values for the parameters must be provided.
• RedPanda - Same interface as Kafka, fast, no data loss, and supports many languages via wasm.