Nov
10
2008

Learn more about using Change Data Capture (CDC) in SSIS 2008

SQL Server 2008 Enterprise includes the new Change Data Capture feature, or CDC, largely intended for use by ETL developers performing incremental loads of a data warehouse. With CDC, you can easily identify rows that have been inserted, updated, or deleted -- no more need for complex queries and other custom solutions! The other day I promised links to some resources, and now they're finally all online. Try the 2 new end-to-end samples on Codeplex Sandra Ward, the developer of CDC, has done extraordinary w... [More]
Nov
5
2008

InfoWorld praises Lookup caching, CDC in SSIS 2008

Read what Sean McCown of InfoWord says about the benefits of Lookup caching and Change Data Capture for the enterprise. "Microsoft has taken some big steps to ensure that SSIS (SQL Server Integration Services) can compete directly with competitors such as Informatica by offering lookup caching and CDC.  ...both lookup caching and CDC can improve the speed of loads by orders of magnitude." InfoWorld praises Lookup caching, CDC in SSIS 2008 How can you learn more about the new features in Lo... [More]
Nov
3
2008

Check out the new Integration Services portal page on MSDN

When you visit the Integration Services page on MSDN or TechNet, you now get fresh and useful links that include community content, rather than a stale set of links to Books Online topics. Here on the Integration Services team, we're happy to be the first SQL Server feature to showcase the new look. Please check it out! SQL Server 2008 – Integration Services on MSDN This page is for you and fellow ETL developers. Use the Feedback link in the upper right to tell us what you like and don't li... [More]
Oct
27
2008

ETL in the cloud, or just for the cloud?

Lots of comments today about PDC and the Microsoft executives discussing Windows Azure, the new platform for cloud computing. "Everyone" - that is, Matthew Roche and Jamie Thomson - noticed (without even being present!) the "ETL" on Bob Muglia's slide, which it's now my turn to borrow: Do folks really want ETL *in* the cloud? That will be interesting to see. If you're interested in ETL *to or from* the cloud today, don't miss the SQL Server Data Services... [More]
Oct
21
2008

Didn't make it to the recent Microsoft BI Conference?

Well, you saved a ton of money, but missed a lot of fascinating presentations. Each hour brought another panicked decision over which talk to choose, from the several available tracks. (Except when Donald Farmer's title promised to make me "cool, smart, and sexy" by hearing about the Data Mining Add-ins for Excel.) But all is not lost! Content from many of the Integration Services presentations is, or will soon be, available... Official SSIS team blogger Matt Masson presented on "best practices for us... [More]
Oct
21
2008

MSDN publishes first 2 articles by Integration Services product vendors

MSDN/TechNet has just published 2 new articles by third-party vendors of commercial products that work with, or complement, SQL Server Integration Services. In Extending Integration Services with the Script Task and Script Task Plus, Ivan Peev of CozyRoc talks about the built-in Script task, then discusses the additional features provided by Script Task Plus, a component that's included in the SSIS+ library from CozyRoc. For example, Script Task Plus lets you reuse the same script easily in more than o... [More]
Oct
21
2008

Connectors now available for SAP BI, Oracle, and Teradata

Both of the promised post-RTM packages of connectors for use with SQL Server 2008 Enterprise and Developer are now available for download, since last Friday's release of the October Feature Pack that contains the SAP BI connector. Each set consists of a connection manager, source, and destination, and is available in both 32-bit and 64-bit versions. In both cases, Microsoft took advantage of the existing expertise of third-party companies to develop these high-performance connectivity components. ... [More]
Oct
16
2008

New 10-minute how-to videos on Integration Services

The Integration Services documentation team at Microsoft recently published its very first batch of 10-minute how-to videos. We hope that beginning to intermediate users will find these useful, and we're pleased to be taking some first steps beyond the written word of BOL.  You can find the entire list of 5 Integration Services and 3 Analysis Services videos at this MSDN page for SQL Server Videos. The Integration Services videos are: Creating a Basic Package (SQL Server Video)   (Thi... [More]
Oct
11
2008

Setting an expression dynamically

Former Integration Services developer Michael Entin recently responded to an interesting question on the internal SSIS discussion list at Microsoft. The user was asking: How can I assign the expression [in this case, for the Derived Column transformation] dynamically at run time? The intuitive but less-than-obvious answer is...use an expression to set the expression! This lets you put your expression in a string variable such as @User::DerivationRule, and assign that by using an expression t... [More]
Oct
9
2008

The first Integration Services 2008 book is now available

 http://www.amazon.com/gp/product/0470247959/ Professional Microsoft SQL Server 2008 Integration Servicesby SQL Server MVPs Brian Knight and Erik Veerman, our own broadly smiling Grant Dickinson, and industry experts Douglas Hinson and Darren Herbold At this writing, US $31.49 on Amazon.com and in stock. Although this is the 2008 update to the 2005 version of the book, it has been massively updated with new material. It has also been carefully tech reviewed by yours truly and several other memb... [More]