http://blog.cloveretl.com/2009/12/09/parallelreader-versus-competitors-finish/ Life, the Universe, CloverETL and everything ... Mon, 26 Jul 2010 20:43:12 +0000 hourly 1 http://wordpress.com/ http://blog.cloveretl.com/2009/12/09/parallelreader-versus-competitors-finish/#comment-65 Petr Uher Sat, 19 Dec 2009 10:40:27 +0000 http://blog.cloveretl.com/?p=319#comment-65 On laptop I set up level of parallelism to 2 in both CloverETL and Pentaho. On server class machine I set up it to 4. This configurations produced the best results. The speed of the transformation is very limited by hard disk performance (CPU utilization never gained 100%). The used hard disks aren't so fast. So I expect that with RAID the performance will increase with a higher level of parallelization. On laptop I set up level of parallelism to 2 in both CloverETL and Pentaho. On server class machine I set up it to 4. This configurations produced the best results.
The speed of the transformation is very limited by hard disk performance (CPU utilization never gained 100%). The used hard disks aren’t so fast. So I expect that with RAID the performance will increase with a higher level of parallelization.

]]> http://blog.cloveretl.com/2009/12/09/parallelreader-versus-competitors-finish/#comment-64 Eddie Sat, 19 Dec 2009 04:15:55 +0000 http://blog.cloveretl.com/?p=319#comment-64 How many parallel threads were used for Pentaho and CloverETL benchmarking? Is there any difference in performance using a higher number of threads on these 2 platforms? How many parallel threads were used for Pentaho and CloverETL benchmarking? Is there any difference in performance using a higher number of threads on these 2 platforms?

]]>