Import data into MySQL using Talend Open Studio I have been trying to import CSV data about 60 MB; it contains about 400,000 rows, which should not be too much.  I tried these ways to import the data:


MySQL Workbench - it took about two hours!!!
Using MySQL LOAD INFILE command - it took about 15 seconds!
Using Talend Open Studio - almost as long as Workbench.


Why are the GUI tools working so badly?  I want to use GUI-based tools, instead of writing scripts.

With Talend Open Studio, is there a way to speed things up?  I heard that there is possibly another Talend product that deals with Big Data, will this do it faster than Talend Open Studio?

Hope someone out there knows!

I know that in Hadoop using Pig, I can get the the CSV from HDFS into Pig memory very quickly.
What parameters are You use for Talend tMySQLOutput? What MySQL settings?
It could not be faster then INFILE, but still really depend from settings.

You can post Your question on TelndForge forum with screen short of Job components, will try to help

For example one of my regular Talend-MySQL Jobs (billing prepare) - transfer from->to mysql 2M of records, 400Mb, it take 6-15 minutes depending from servers (we have 2 configuration)  

edit, because always better 1 time to show, than 100 times explain 

2.3M rows, 300Mb file, speed of tMySQL with 100 rows per insert:


same with 10 000 rows per insert


tBulkOutputExec:


but then total time:
original 10 000 rows:


bulk:

just because after execution it wait commit transaction, single transaction