Thursday, March 29, 2012

ETL library

We are looking for an ETL library or callable application that would
allow us to transfer and transform data between platforms but mainly
into a SQL server database. We would be calling this tool from
javascript programs. Is there something out there in the midrange
price-wise? So far I am finding just high-end ETL tools that are a
little over kill for us.

Thanks."elizabeth" <ezelasky@.hotmail.com> wrote in message
news:78393913.0409150439.818af56@.posting.google.co m...
> We are looking for an ETL library or callable application that would
> allow us to transfer and transform data between platforms but mainly
> into a SQL server database. We would be calling this tool from
> javascript programs. Is there something out there in the midrange
> price-wise? So far I am finding just high-end ETL tools that are a
> little over kill for us.
>
> Thanks.

Have you looked at DTS, which is included with MSSQL? It has a command-line
executable and a COM interface available. See "Data Transformation Services"
in Books Online for more details.

If DTS isn't suitable for you, you might want to be more specific about what
features you require.

Simon|||Folks here felt that DTS was slow (copied record by record) and buggy
that is why I was asked to search for something else. What we need is
fairly basic...to be able to move large amounts of data (in some
cases > 2 gigs) between a variety of sources (flat files, FoxPro &
Dbase) into a SQL Server database. We need to be able to set or
specify the table structure "on-the-fly" thus the reason for calling
it from a scripting environment or another environment.

Thanks.
> Have you looked at DTS, which is included with MSSQL? It has a command-line
> executable and a COM interface available. See "Data Transformation Services"
> in Books Online for more details.
> If DTS isn't suitable for you, you might want to be more specific about what
> features you require.
> Simon|||DTS can use 'fast load' bulk insert techniques to import data. This is the
fastest way to get data into SQL Server. You can create DTS packages 'on
the fly' programmatically and have control over the object model.

--
Hope this helps.

Dan Guzman
SQL Server MVP

"elizabeth" <ezelasky@.hotmail.com> wrote in message
news:78393913.0409151028.7fcc0aca@.posting.google.c om...
> Folks here felt that DTS was slow (copied record by record) and buggy
> that is why I was asked to search for something else. What we need is
> fairly basic...to be able to move large amounts of data (in some
> cases > 2 gigs) between a variety of sources (flat files, FoxPro &
> Dbase) into a SQL Server database. We need to be able to set or
> specify the table structure "on-the-fly" thus the reason for calling
> it from a scripting environment or another environment.
> Thanks.
>>
>> Have you looked at DTS, which is included with MSSQL? It has a
>> command-line
>> executable and a COM interface available. See "Data Transformation
>> Services"
>> in Books Online for more details.
>>
>> If DTS isn't suitable for you, you might want to be more specific about
>> what
>> features you require.
>>
>> Simon|||One alternative is a "roll your own" solution. Create linked servers and
just run UPDATE/INSERT/ SELECT INTO statements. The problem is always
making sure you have the relevant drivers on th dev and production
enviroments. The enclosed link gives most of the connection strings needed.

http://www.able-consulting.com/ADO_Conn.htm

I'll warn you before you start this can get messy.

Regards

Adrian

elizabeth wrote:

> Folks here felt that DTS was slow (copied record by record) and buggy
> that is why I was asked to search for something else. What we need is
> fairly basic...to be able to move large amounts of data (in some
> cases > 2 gigs) between a variety of sources (flat files, FoxPro &
> Dbase) into a SQL Server database. We need to be able to set or
> specify the table structure "on-the-fly" thus the reason for calling
> it from a scripting environment or another environment.
> Thanks.
>>Have you looked at DTS, which is included with MSSQL? It has a command-line
>>executable and a COM interface available. See "Data Transformation Services"
>>in Books Online for more details.
>>
>>If DTS isn't suitable for you, you might want to be more specific about what
>>features you require.
>>
>>Simon

No comments:

Post a Comment