Matillion

Avantages

I use it on a daily basis when we process incoming client data of different types. It can be used to build extremely complex workflows to handle data. The automation done on the platform rarely broke and was really stable even during peak data transfer intervals.

Inconvénients

The changes made to the workflows on the platform are saved automatically which can be tricky if you make a change by mistake. So whenever you click a wrong button or value, it will be saved unless you undo the changes made and when working with huge complex workflows it can be really time-consuming to find the source of the issue.

Avantages

The ease to use, Matillion has a great set of tools that make complex and difficult process more simple and fast to develop.

Inconvénients

There are many tools in Matillion that doesn't have enough attention and because of that these tools are fragile, while some of them do not work.

Avantages

I've been using Matillion for about 2 and a half years. I've seen the software improve so much in that time. If I ever found a feature to be lacking, it would be included within the next couple release cycles. The software really seems to adapt as user needs have been evolving. Some of my favorite recent features are the ability to configure some components with just text (really saves me time) and the many Grid orchestration components which allow me to greatly reduce the complexity of the orchestration jobs.

Inconvénients

UX is sometimes lacking or inconsistent. For example, let's say my goal is to replace an existing job with a new job of the same name. I delete the old job, and import the new one with the same name. All Orchestration components that used that job will understand to use the new job, but for some reason the scheduler doesn't.
Also, jobs will have validation errors simply because the components haven't been validated (grey borders). It can be confusing because you may be searching for an error in your work when all you actually have to do is revalidate the job.

Avantages

I like the bunch of API integrated in Matillion it helps me to directly grab the data from different sources without manually extra and import in my database.

Inconvénients

I am using Matillion for Redshift from last more than 2 years. When i setup a project in Matillion with connection to a Redshift cluster, sometimes there is a need to extract the data from other instance of Redshift while running job in Matillion. In that case there is straight forward way of getting the data from other instance of Redshift like you have comments to extract the data from databases like SQL Server, Oracle etc. instead of first i need to run another job by connection second Redshift cluster and extract the records after that run different job to load the extracted records from S3 to main Redshift cluster.

Avantages

+ Fast & easy to use
+ Completely embedded into AWS environement
+ Comes light, it's not overloaded with stuff no one uses
+ Some really innovative features

Inconvénients

- Sometimes feels like not "fully under control", e.g. when a component runs into an OutOfMemory, the whole environement crashes. And there are different ways to trigger that...
- Scheduling overview could be more sophisticated, it's kind of hard to have a proper overview there
- Variable handling seems sometimes to be a bit difficult, e.g. when setting it in one process, it's not always set in sub-jobs
- In some cases, one can see that Matillion is still "under development": Same features are available in some components, but are missing in others

Avantages

- Quick to start
- Consumption based model
- Works well with Snowflake

Inconvénients

- Harder to find resources with skills
- Cost relatively higher

Avantages

The ease of use is definitely the strongest aspect of Matillion. The GUI is exceptionally intuitive and even though the application flow speaks for itself, the documentation is also great for additional support.

Inconvénients

You can hit a hard limit quite fast with the hardware when working with concurrent jobs running (Java Heap issues etc). You cannot increase the size of the instance (m4.xlarge) which means it becomes increasingly difficult to optimize. We are always trying to find work-arounds with the amount of data we need to load.

Avantages

Makes for very fast development with lots of built in connectors. Visual layout of complex data pipelines is a big plus.

Inconvénients

Out of memory errors. We use this for a lot of production applications. After 1 year of trying to fix OOM errors and doubling our instance size, we still get them monthly. I love matillion but I wish it were more reliable.

The billing structure contributes to the problem as well. We can't run matillion on a big instance without significantly increasing our licensing fees. I wish they were independant.

Avantages

It's fast. Pipelines are easy to setup for very basic tasks.

Inconvénients

Your customer support people are useless. Every time I submitted a ticket, they simply pointed to an article on the Matillion website that is not helpful in solving the problem. There is no community to resolve common issues. Troubleshooting complex tasks is almost impossible for smaller organizations.

Avantages

From an engineers point of view one of the selling points for Matillion (apart from the absolute simplicity of use - at least to start with) is that it produces its own documentation !!

Inconvénients

Sometimes the error messages can be confusing , but this is often down to the messages coming from BigQuery.

Its also not always obvious that it is producing SQL statement 'under the hood' and that can mean breaking sql statement size limits without realising it

Avantages

ease of use! someone with little code knowledge can come in and understand what's going on, it's very easy to follow along and see the transformation step by step

Inconvénients

API connectors could be better. Could be more available, and a little more ease of use (especially with the endpoint mapping)

Alternatives envisagées 

Avantages

1.)All the components and transfomrations availability
2.)Specially oriented for data ingestion process using all aws services like rds, s3, sns, redshift
3.)easy admin, ssl setup
4.)very easy diagromatical representation of jobs

Inconvénients

the latest button change for "switch version"

Avantages

Matillion allowed us to move a legacy ETL pipeline to BigQuery with speed, precision, and confidence. It is now used exclusively by our team for all of our ELT needs. The user interface is clean, intuitive, and allows members of the team to be immediately productive. Onboarding new users has never been easier.

Inconvénients

Feature parity between the different flavors (Redshift, Snowflake, BigQuery) is lacking, however, Matillion continues to make progress in narrowing the gap.

Avantages

Easy to use for non-tech (engineers) users.

Inconvénients

Lacks testing stage before production and more flexibility to sample data.

Avantages

Matillion is very easy to use. It's simplicity allows you to drag an drop components to easily create orchestrations. It also simple to create shared jobs and use the components.

Inconvénients

Although there is a decent set of components, they are not very versatile, hence I end up using a SQL script instead. For example, the S3 unload component does not allow one to specify some criteria and some fields are mandatory whereas I would not have to specify such specific criteria when doing this from an SQL script.

Avantages

Is easy and is real pay as you use, that is very important for latinoamerica business

Inconvénients

That you can't write in other destinations

Avantages

Well integrated with AWS. Great browser-based interface. Develop in the same place where the code will run, as opposed to other solutions I use that develop in Windows and run in Linux. Easy to schedule.

Inconvénients

I have mixed feelings on the overall value. The hourly rate really adds up over time. This is probably my biggest misgiving. Otherwise, I sometimes get frustrated with the ELT model because it means if the feature you need isn't supported within Redshift, it's up to you to create Python scripts or Bash scripts to enable it.

Avantages

Easy to learn
Visual interface
Pretty reliable

Inconvénients

Version control
Search
Explaining dependencies

Avantages

Quick development capabilities to perform full load, incremental load with change data capture (CDC), process chains, job scheduling and monitoring, job success/failure notification, customer support to name a few

Inconvénients

Wish to see Matillion having Github control

Avantages

Easy to learn and use. The knowledge from other products is transferable. The documentation is amazing (one probably cannot understand how good without the experience). Support is always available and of good quality.

Inconvénients

There is no restart-from-point-of-failure option for failed loads. Everything has to start from scratch or remaining jobs need to be run manually.

Avantages

1) Easy to use
2) Several ingestion integrations
3) Custom RDBMS ingestion support
4) Robust transformation and Orchestration components

Inconvénients

No availability of change data capture feature for many databases

Avantages

Matillion is easy to integrate into our snowflake system. We use it to build and create materialized tables and views, run scheduled builds, and have used it to create CDC processes. It is slick and intuitive and has a great user interface.

Inconvénients

The browser and platform crashes occasionally, about once a week. The account will log you out, but it works in real time so it usually does not delete any of your work.

Avantages

The tool was very easy to use and was intuitive most of the time. The functions and components for RedShift were amazing even though I didn't use them

Inconvénients

1. Initially the customer service was good, calls were being scheduled either on the same day or on the next day. But once you start using it, support calls would take weeks. Sometimes support will say they'll get back to you but they don't.
2. In one particular instance, a support executive said they would get back to me because they couldn't find an immediate solution, but even after 3 weeks there was absolutely no response on their side. I got a reply after I followed up again though.
3. There are good amount of components for RedShift which are not available for SnowFlake, I hope they would incorporate them as soon as possible.

Avantages

I don't have to babysit the software. Using automation and integration with AWS, I can get messages if there are issues with any orchestration jobs.

Inconvénients

Getting the API pulls working was a little clunky, but it came together relatively quickly utilizing Matillion's support. Their support team is fantastic!

Avantages

Easy to use, graphical way to do data flows on Google Cloud

Inconvénients

The most missing functionality, is to be able to setup data destinations additionally to BigQuery

Avantages

Matillion ETL is web based ETL tool and very easy to use from anywhere. It has most of the connectors for all data sources which makes my job to complete end to end development.

Inconvénients

One thing I did not like about Matillion is, there is no need of Transformation job. Everything should be done at one place(Should be in Orchestration job). Also, the list of components are different in Orchestration and transformation jobs.

Avantages

Matillion is the most reliable ETL/ELT tool currently. I've worked with a larger number of clients that have uses Matillion as well as other tools and Matillion is definitely the most reliable. The UI is easy to follow and understand and the learning curve is small.

Inconvénients

The technology isn't as intuitive as others in the space. It does require some training or knowledge of workflow development though it's the most reliable.

Avantages

I appreciate the ease of use of the tool. It is very simple and intuitive to build data pipelines using Matillion.

Inconvénients

It's necessary to perform out own server maintenance to support the tool, which isn't too difficult, but can be a pain at times. If this were a hosted solution that would be easier.

Alternatives envisagées 

Pourquoi passer à Matillion

Avantages

Matillion integration with AWS services is flawless and has real time impact in batch jobs pulling data from on-premises to cloud platform.

Inconvénients

Restricting the number of user can access Matillion, Lot's of time huge data set get stuck and fail with many other issues lastly better full log specifically for Developer to debug the issues.

Avantages

Matillion offers a powerful feature set within a robust UI. There are other options but none have the ease of onboarding that Matillion offers. The API adds a powerful layer to do advanced integrations.

Inconvénients

Some threads have become unresponsive while running. This has been rare and was easy enough to resolve by resetting the service.

Avantages

Matillion was very easy to set up, it allow us to quickly build out our ETL/ELT pipeline on AWS. GUI was easy to navigate, most default functions works well, it has the ability to connect to all of our required cloud data sources, and any custom function can be scripted using Python.

Inconvénients

Python scripting is very limited, it is used mostly to assigned variables or run simple boto3 script. We tried using the python module to run heavy CPU data cleansing process and the software timed out.

Avantages

It's very easy to use, great training and support.

Inconvénients

I don't have any cons. From start to end they have been great to work with.

Avantages

I like the stability of the product. We haven't updated our version since we started.

Inconvénients

Can't use simple SQL Functions like CURRENT_DATE in FIlter Component. And no Automatic Update.

Avantages

Integration with GCP API calls and cloud storage.
Easy of access from anywhere.
Self documentation.
Customer service.
Automatic updates.

Inconvénients

Failure capture process.
Any changes made not needing to be saved. Accidental changes are considered saved at click of the button.
No front end customisation available to distinguish between different environments. Having to use 3rd party add ons.

Avantages

* If you've done any type of ETL work before, this will be a breeze. If you haven't it might take a few hours as opposed to minutes to get up and running
* The trial is full featured, get started today without waiting
* The software is on a EC2 instance in your own VPC in AWS. If you have company policies for how/where data can be processed -- you have complete control
* You can pay by the hour or the year, no hassle no fuss!

If you do encounter an issue the support organization is amazing. All questions were answered the same day, many within the hour.

Inconvénients

More examples to work through on the transformation components would be helpful, but again... it's pretty easy

Alternatives envisagées 

Avantages

- It has very good UI to design the workflow.
- It is easy to design the workflow.
- It has very good support with persistence storage. Like snowflake, redshift, etc.

Inconvénients

- It should also support Azure data warehouse.

Avantages

Its ability to automate repetitive tasks. Also, it has some quite useful built-in database functions that I wish MySQL had -- for example a search/replace function that can use regular expressions.

Inconvénients

It's not very intuitive and not very easy to learn (although the support team is amazingly responsive and helpful).

Avantages

Very easy to use and very easy to get results. Fast implementation cycles compared to other tools. Best is to loop over variables which enables simple but powerful solutions.

Inconvénients

Sometimes more flexibilty on specific tasks, e.g. Excel import or csv.

Avantages

Logic drag & drop of ETL steps makes the design and documentation of each ETL processes much simpler.

Inconvénients

Getting it setup and connected to our data warehouse seemed to be unnecessarily complicated. Luckily tech support is great and helped my DevOps team throughout the process.

Alternatives envisagées 

Avantages

* It's very easy to start building scalable production ready ETL pipeline.
* GUI is very intuitive.
* Has wide variety of integrations available.
*

Inconvénients

* Error handling/debugging is on a poor level.
* No good way to version queries/scripts or jobs.
* Not really suitable if you need to build something very complex, as it's not very customizable.

Avantages

I love the GUI that Matillion employs - it makes creating and adjusting tasks very simple and transparent.

Inconvénients

The scheduling of tasks is a little tricky, as we have to separately have to schedule the virtual machine to fire up and down. Once this is done though, it works faultlessly.

Avantages

The features and ease of use are good. The transformations act as a documentation for the self because of the readability.

Inconvénients

The customer service is very poor. When they eventually respond to messages it is with an unhelpful response. Generally they will blame us for issues on their end, or they misunderstand the problem completely. It's not what we need from a tool

The paid training we took was also pretty basic

Avantages

Simple with not a lot of unnecessary components. Very easy to use with Amazon Redshift.

Inconvénients

Licensing mechanism not good. We had problem when trying to increase license to 6 person from 5. Integrating with Git or other source control tool not easy.

Avantages

Ease of use and breadth of functionality.

Inconvénients

We had a billing issue at one point when trying to renew but that was mostly due to AWS Marketplace and not Matillion as a product.

Avantages

User interface is very easy and any one can mange development things without too much of knowledge. Matillion have very content on official site and It help's a lot to make hands on on this tool.
In few click we can connect any database weather it is on premises or cloud. I have extracted data from different source system and loaded in to redshift in very easy and fast manner.

Inconvénients

I don't see straight forward job Audit framework. Please try to build nice job monitoring and audit framework.

Avantages

Pretty straightforward compared to other ETL tools, traditional engineers pick up in no time at all.

Inconvénients

The google version is not as rich as the AWS one

Avantages

Easy to understand and follow processes. Easy to pass variable values between jobs. Works well with Redshift and S3.

Inconvénients

Use of API's can be a little confusing to setup/configure.

Avantages

The GUI and design makes it easy to not only functionalize your ELTs, but also show a graphical DAG to stakeholders.

Inconvénients

I wish it had an out-of-the-box API gateway to receive webhook requests from third-party data sources.

Avantages

Ease of Use and excellent support which makes this software likely to use in comparison to other ELT tools.

Inconvénients

Does not compatibility with Genetics connector like VCF or BAM

Avantages

Easy to Use , Easy to Understand , Drag and drop features , Help with all components really helpful

Inconvénients

Less Features as compared to TOS , All features not there as per documentation