AWS Data Pipeline

4.1
(15)

AWS Data Pipeline is a web service that helps you process and move data between different AWS compute and storage services, as well as on-premises data sources, at specified intervals.

Work for AWS Data Pipeline?

Learning about AWS Data Pipeline?

We can help you find the solution that fits you best.

Categories

AWS Data Pipeline Reviews

Chat with a G2 Advisor
Write a Review
Filter Reviews
Filter Reviews
  • Ratings
  • Company Size
  • User Role
  • Industry
Ratings
Company Size
User Role
Industry
Showing 17 AWS Data Pipeline reviews
LinkedIn Connections
AWS Data Pipeline review by Administrator
Administrator
Validated Reviewer
Verified Current User
Review Source

"Stable and Gets the Job Done, Feels a Bit Dated at Times"

What do you like best?

A pretty straightforward way to run batch jobs, whether that's ETLs, or some sort of other CRON based job. The tool is quite customizable with what can be done (arbitrary shell scripts) and integrates well with S3 and EC2

What do you dislike?

There are times when something that should just work is very difficult. For example, the default EC2 instance AMI was very very old and thus, the tools installed on it have to all be upgraded before being used (like the AWS CLI). Everything can be customized, however, including the image, but this takes a little bit of time to get working and can be confusing when just getting started. This particular example has been resolved, but there are other that are similar.

What business problems are you solving with the product? What benefits have you realized?

We are ETL-ing data and running batch transform jobs. AWS Data Pipeline allows us to do all of this, although there are definitely some setup costs involved.

Sign in to G2 Crowd to see what your connections have to say about AWS Data Pipeline
AWS Data Pipeline review by Sakshi J.
Sakshi J.
Validated Reviewer
Review Source

"data pipeline is very good and easy "

What do you like best?

managed service by amazon to move data from one source to another source very fast and in automated way with high availability in reliable way. we can modify or set at what time we need to run this and only charged when we use this, very good and managed service by amazon, very reliable flexible and low cost to use.

What do you dislike?

sometime pipeline stuck with waiting on dependencies other wise all things are very good in this service provided by aws.

Recommendations to others considering the product

Its solving main issue of banking system that is data processing in very easy and fast way, everyone should need to use this.

What business problems are you solving with the product? What benefits have you realized?

Its solving data processing techniques with real time data, easy to use and fast and flexible. Should be use by everyone.

What ETL Tools solution do you use?

Thanks for letting us know!
AWS Data Pipeline review by Consultant in Management Consulting
Consultant in Management Consulting
Validated Reviewer
Review Source

"Reliably process and move data between different AWS compute and storage services"

What do you like best?

I like the way AWS easily createS complex data processing workloads that are fault tolerant, repeatable, and highly available. You don’t have to worry about ensuring resource availability, managing inter-task dependencies, retrying transient failures or timeouts in individual tasks, or creating a failure notification system. AWS Data Pipeline also allows you to move and process data that was previously locked up in on-premises data silos.

What do you dislike?

Data Pipeline is sometimes difficult to utilize.The most difficult part of the AWS Data Pipeline uses are the Error messages which occur very easily. I do not like the fact that there are no time notifications which makes it difficult to fully utilize some of the features. Sometimes, it's impossible to understand exactly what the issues are in this program. and it is difficult to understand what exactly failed since it is an amazon service.

Recommendations to others considering the product

Unless you have your own IT department to develop your own pipeline, AWS is a great outsourced solution to data warehousing and usage. The system can be manipulated to solve specific data transfer issues. The scheduler feature allows one to automatically create functions that are used at pre-scheduled times.

What business problems are you solving with the product? What benefits have you realized?

The data pipeline between storage and warehousing and end user is seamless. Prior to AWS data pipeline, we had to manually import data sets. Now, we schedule these processes to work on an automated basis.

AWS Data Pipeline review by User
User
Validated Reviewer
Review Source

"aws data pipeline is very good and managed service of aws"

What do you like best?

Its a very good and managed service provided by amazon to move the data from one source to another with high availability and reliable process. We can set it on data sources and can be modified at what time of interval we need to run this, it automatically works and send the data.It is very simple, easy to use, flexible, reliable services and having low cost.

What do you dislike?

it has all advantages but sometime pipeline stuck with waiting on dependency component. Otherwise it is very useful and very good service.

Recommendations to others considering the product

Very good and real time service and mostly used by companies and everyone should need to use this. Its solving main problems of our business for data transferring.

What business problems are you solving with the product? What benefits have you realized?

Its solving our data transfer problems a lot in real time, AWS data pipeline is very useful service in which we can send data from one source to other source like from s3, rds, instances and lambda is like data pipeline services most of the companies using today, which is very fast and useful.

AWS Data Pipeline review by Sheehan A.
Sheehan A.
Validated Reviewer
Review Source

"Powerful, but needs better GUI Tools"

What do you like best?

AWS Data Pipeline makes it very easy to get started and move data between various sources. If you're already using AWS services such as S3 or Redshift, Data Pipeline heavily reduces the lines of code / applications required to move data between AWS data sources.

You can simply run data pipeline on a schedule, specify where you want to move data between, and tell it to run processing in a series of steps if you need to filter your data. It is a good and simple way to do basic data movement.

Pipeline retries, gives you errors, and has a dashboard that shows you all of the jobs that are in queue.

What do you dislike?

Data Pipeline can be a black box at times. Error messages are not good, and it is difficult to understand what exactly failed since it is an amazon service. The scheduler doesn't give timely notifications at times, so it is hard to determine the true state of the data pipeline

Recommendations to others considering the product

If you are a small company and don't want to spend resources building your own pipeline, use AWS. It is out of the box, gets the job done, and you can learn to work around some of its deficiencies. It provides a great way to schedule the movement of data.

What business problems are you solving with the product? What benefits have you realized?

We have various ETL jobs that run on data pipeline. We move data between various sources into a data warehouse for final reporting. Data pipeline is used to move all data into a single data lake, and then run pre-processing steps before loading into a warehouse.

AWS Data Pipeline review by Bhupesh b.
Bhupesh b.
Validated Reviewer
Review Source

"data pipeline is easy to use and managed service"

What do you like best?

aws data pipeline is very good managed and reliable service which helps us to solve data service from one source to another source and helping to solve data filterring issues, we are using data source problems and very usefull service.

What do you dislike?

Its main dislike is cost and sometime data stucks in pipeline.

Recommendations to others considering the product

Its solving data issue like sending data from one place to another place

What business problems are you solving with the product? What benefits have you realized?

Its solving main problem of sending data from one source to another source by this service.

AWS Data Pipeline review by User
User
Validated Reviewer
Review Source

"Connect Multiple Amazon Web Services into one worflow"

What do you like best?

AWS Data Pipeline has GUI based designing tool which makes it very easy to understand the workflow and configure some of the complex workflow easily

What do you dislike?

Resource take bit more time to setup from data pipeline that directly. In my case i use Amazon EMR cluster in join with a Lambda function. Lambda runs quickly but EMR takes a lot of time to setup, even after the resources are provisioned and cluster is read to accept jobs the first job arrive to cluster very late. almost 9-10 min late.

Recommendations to others considering the product

Great tool for workflow automation

What business problems are you solving with the product? What benefits have you realized?

Automation of Amazon EMR Jobs on a schedule based architecture.

No need of human interaction once the pipeline is test for errors.

AWS Data Pipeline review by Aishwarya S.
Aishwarya S.
Validated Reviewer
Review Source

"Amazon web service data pipeline "

What do you like best?

amazon web service data pipeline is an amazing feature of the AWS. it is great aminity to be haven for a data scientist.

What do you dislike?

I would say there is nothing about the amazon web service data pipeline that I dislike. It is an amazing tool to be used

What business problems are you solving with the product? What benefits have you realized?

I am a student in Columbia and I used it for some of my project. It was a very nice experience to use it as it streamlines your work

AWS Data Pipeline review by suresh s.
suresh s.
Validated Reviewer
Review Source

"Only Best Tool We Know"

What do you like best?

very convenient tool for migration of data from one DB to another no matter which DB are we using

What do you dislike?

Nothing as of now till the time we can something to compare with other vendor services

What business problems are you solving with the product? What benefits have you realized?

It is used when we need to import and export dynamo DB data through this product

AWS Data Pipeline review by sujeet k.
sujeet k.
Validated Reviewer
Review Source
Business partner of the vendor or vendor's competitor, not included in G2 Crowd scores.

"Good tool to use"

What do you like best?

AWS is User friendly,it is reliable, we can manage big projects easily.

What do you dislike?

Its is difficult to setup.

AWS is Space consuming.

Pipeline and component usually stucks.

Recommendations to others considering the product

Code Pipeline is better than data pipeline.

What business problems are you solving with the product? What benefits have you realized?

ETL process is done in our company.

AWS Data Pipeline review by Michael B.
Michael B.
Validated Reviewer
Review Source

"Just stared using the system"

What do you like best?

The ability to manage tasks and related data; particularly on larger projects

What do you dislike?

Recently brought it on board, so the issues we're experiencing have mostly related to the learning curve of a new system.

What business problems are you solving with the product? What benefits have you realized?

Managing data associated with our pipeline

AWS Data Pipeline review by Jay P.
Jay P.
Validated Reviewer
Review Source

"Cool stuff "

What do you like best?

Awesome speed - super cool tool to work with

What do you dislike?

License version is expensive and takes time for initial user to get hands dirty

What business problems are you solving with the product? What benefits have you realized?

Data integration and streamlining has never been so easy

AWS Data Pipeline review by Administrator in Higher Education
Administrator in Higher Education
Validated Reviewer
Review Source
Business partner of the vendor or vendor's competitor, not included in G2 Crowd scores.

"Easy to use | Customizable | Reliable data pipe line builder "

What do you like best?

It can be customized very easily, so can be used by non-programmers as well to get the job done. Very reliable and fault tolerant.

What do you dislike?

Does not have support to many new open source databases

Recommendations to others considering the product

I recommend everyone to try it. It is useful as it can save a lot of time building our own data pipeline.

What business problems are you solving with the product? What benefits have you realized?

built a data processing pipeline to optimize APIs which had huge traffic

AWS Data Pipeline review by User in Telecommunications
User in Telecommunications
Validated Reviewer
Review Source

"aws data pipeline is very easy and popular service to send data from one source to another"

What do you like best?

automation and movement of data from one place to another place

What do you dislike?

pipeline and component stuck and sometime it didn't found exceptions

Recommendations to others considering the product

esay to use and fully secured

What business problems are you solving with the product? What benefits have you realized?

sending and securing data from our system to aws and saving cost. sending our data to s3 and glacier

AWS Data Pipeline review by User in Internet
User in Internet
Validated Reviewer
Review Source

"Json blob is a horrible way to organize jobs"

What do you like best?

The only thing I can appreciate is once it is setup then it is fine.

What do you dislike?

It really should be redesigned as a json blob is a terrible way to organize SQL jobs. Why can't things be scheduled like a calendar or meeting request?

What business problems are you solving with the product? What benefits have you realized?

We use it for our ETL process.

AWS Data Pipeline review by Internal Consultant
Internal Consultant
Validated Reviewer
Review Source

"Best option to transfer data between storage devices"

What do you like best?

User friendly, reliable as it retries in case of any failure.

What do you dislike?

Space consuming, difficult to setup and lags on slow in internet.

What business problems are you solving with the product? What benefits have you realized?

In case of emergency we transfer data one server to another server with the help of aws DP.

AWS Data Pipeline review by User in Computer Software
User in Computer Software
Validated Reviewer
Review Source

"A good DB alternative"

What do you like best?

Simplicity compared to software like SQL

What do you dislike?

Integration with something other than AWS could be stronger.

Recommendations to others considering the product

Pull the trigger!

What business problems are you solving with the product? What benefits have you realized?

It’s a cheaper and simpler DB tool to use. Not much else to say.

Kate from G2 Crowd

Learning about AWS Data Pipeline?

I can help.
* We monitor all AWS Data Pipeline reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. Validated reviews require the user to submit a screenshot of the product containing their user ID, in order to verify a user is an actual user of the product.
Categories