Showing posts with label folks. Show all posts
Showing posts with label folks. Show all posts

Thursday, March 29, 2012

ETL from multiple Access databases -SSIS?

Howdy Folks,

I have an ETL project that I want to ask a question about. I want to loop through a folder containing several Access databases, and extract and load each one into a single SQL Server 2005 database. The table layout is the same for all the Access dbs, as well as the SQL db. The number of Access dbs in the folder, their records, and their names will change. Is there a way i can use the SSIS Foreach tool to move through the folder and set the connection string inside the loop?

Thanks for your reply,

Chris

Yes, you can do this.

Use the ForEach File Enumerator to enumerate your list of files. you can use wildcards (e.g. *.mdb)

Store the file path of each file in a variable. You can then use the contents of that variable to dynamically build your connection string using an expression.

Lots of information via Google about this stuff if you want to go hunting or ask here with any pertinent questions.

Regards

-Jamie

|||

Thanks Jamie (alot ) for your suggestion. I tried using the Foreach File Enumerator with the root path for the Access files and a *.mdb wildcard. Then I created a mapped string variable varFileNameto hold the file path. Inside the loop i have my Data Flow Task. In the data source for the task, I was using the variable in an expression as the ConnectionSting property which didn't work. So I added an OLE DB connection string in the expression like "Provider=Microsoft.Jet.OLEDB.4.0;Data Source=" + @.[User::varFileName] but i don't think that's the answer.

I've been googling on this but can't find solutions for multiple .mdb's, most of waht i find is dealing with flat files. Great blogs btw.

|||

Should be able to find all you need here: http://www.connectionstrings.com/

-Jamie

|||

Yep, i went there. Thanks Jamie. My string was ok. Actually what got me running was to set the Foreach Loop Container>Properties>Execution>DelayValidation = True. Works great running the SSIS package on the box with SQL server (as opposed to OLE DB) destinations.

Wednesday, March 7, 2012

Errors

Folks,
This might not be SQL Server related, but nevertheless, it brought our production sql server to a halt. Does anyone know what these entries mean?
System log:-
Event Type:Error
Event Source:Perflib
Event Category:None
Event ID:1015
Date:7/20/2004
Time:4:24:56 AM
User:N/A
Computer:TOROONDC975
Description:
The timeout waiting for the performance data collection function
"PerfOS" in the "C:\WINNT\system32\perfos.dll" Library to finish
has expired. There may be a problem with this extensible counter
or the service it is collecting data from or the system may have
been very busy when this call was attempted.
Application log:-
Event Type:Information
Event Source:Application Popup
Event Category:None
Event ID:26
Date:7/20/2004
Time:6:45:21 PM
User:N/A
Computer:TOROONDC975
Description:
Application popup: cmd.exe - Application Error : The application
failed to initialize properly (0xc0000142). Click on OK to terminate
the application.
Any guidance is much appreciated.
Karthik.
PS: We are running
SQL 2K Enterprise Edition SP3
Windows 2K Advanced Server
What do the sql error log say? That error message doenst seem like an event
that could bring a machine down.
Vikram Jayaram
Microsoft, SQL Server
This posting is provided "AS IS" with no warranties, and confers no rights.
Subscribe to MSDN & use http://msdn.microsoft.com/newsgroups.
|||Well, it occured on a server that happened to be our production SQL Server. Not really a SQL Server error. Anyways, the reason this brought our server down was because there was about 150 CMD.EXE running when we looked at the unresponsive server in the mo
rning. And we found the errors I have attached in the event viewer.
Thanks.
"Vikram Jayaram [MS]" wrote:

> What do the sql error log say? That error message doenst seem like an event
> that could bring a machine down.
> Vikram Jayaram
> Microsoft, SQL Server
> This posting is provided "AS IS" with no warranties, and confers no rights.
> Subscribe to MSDN & use http://msdn.microsoft.com/newsgroups.
>
>

Errors

Folks,
This might not be SQL Server related, but nevertheless, it brought our produ
ction sql server to a halt. Does anyone know what these entries mean?
System log:-
Event Type: Error
Event Source: Perflib
Event Category: None
Event ID: 1015
Date: 7/20/2004
Time: 4:24:56 AM
User: N/A
Computer: TOROONDC975
Description:
The timeout waiting for the performance data collection function
"PerfOS" in the "C:\WINNT\system32\perfos.dll" Library to finish
has expired. There may be a problem with this extensible counter
or the service it is collecting data from or the system may have
been very busy when this call was attempted.
Application log:-
Event Type: Information
Event Source: Application Popup
Event Category: None
Event ID: 26
Date: 7/20/2004
Time: 6:45:21 PM
User: N/A
Computer: TOROONDC975
Description:
Application popup: cmd.exe - Application Error : The application
failed to initialize properly (0xc0000142). Click on OK to terminate
the application.
Any guidance is much appreciated.
Karthik.
PS: We are running
SQL 2K Enterprise Edition SP3
Windows 2K Advanced ServerWhat do the sql error log say? That error message doenst seem like an event
that could bring a machine down.
Vikram Jayaram
Microsoft, SQL Server
This posting is provided "AS IS" with no warranties, and confers no rights.
Subscribe to MSDN & use http://msdn.microsoft.com/newsgroups.|||Well, it occured on a server that happened to be our production SQL Server.
Not really a SQL Server error. Anyways, the reason this brought our server d
own was because there was about 150 CMD.EXE running when we looked at the un
responsive server in the mo
rning. And we found the errors I have attached in the event viewer.
Thanks.
"Vikram Jayaram [MS]" wrote:

> What do the sql error log say? That error message doenst seem like an even
t
> that could bring a machine down.
> Vikram Jayaram
> Microsoft, SQL Server
> This posting is provided "AS IS" with no warranties, and confers no rights
.
> Subscribe to MSDN & use http://msdn.microsoft.com/newsgroups.
>
>