Archive for category Ottawa Events
Introducing Microsoft SQL Server 2012
Posted by Scott Andrews in Business Intelligence, ETL, Ottawa Events, SQL Server on May 11, 2012
Last night I attended a presentation hosted by OttawaSQL.net and presented by Matt Masson on the newly released SQL Server 2012. I was principally interested in the new SQL Server service Data Quality Services (DQS), the latest addition to the SQL Server lineup.
Boiled down to its simplest form, DQS acts as a data “spell checker” that can apply statistical data correction, user-defined knowledge base data correction, or third party web service data correction. In the DQS interface, users define Term Based Relations (TBR) rules which can be applied against the data set. While correcting data, DQS will generate its own list of rules which you can validate.
Another relative newcomer to the SQL Server lineup is Master Data Services (MDS), which first appeared in SQL Server 2008 R2. This serves as a central repository of “golden” records, the single source of validated truth. It allows for a Master Data model to be generated and kept. This then serves as a lookup source for Integration Services packages.
SQL Server Integration Services (SSIS) is still the lynch-pin of data movement in the SQL Server environment. It integrates seamlessly with the DQS and MDS services. It has seen feature enhancements and improvements such as a catalog feature (for ease of configuration, security and management), change data capture, and built in reports for troubleshooting and logging.
Anyone interested in a deeper understanding of SQL Server 2012 should note that Microsoft will be hosting a free day-long workshop on June 22 at their Ottawa office.
Wayne Eckerson @ TDWI Ottawa
Posted by Peter Beck, CBIP in Business Intelligence, Ottawa Events, Tech Trends on February 20, 2012
Wayne Eckerson is a noted BI consultant who spoke recently to the Ottawa TDWI chapter. I’d call Wayne a guru, but someone once told me that guru was a polite word for charlatan. Wayne is the very opposite – he is a very down-to-earth speaker who delivered a direct, unpretentious and thoughtful presentation on the subject of BI organizational architecture.
One of Wayne’s interesting observations was that he sees the need for what he calls “purple people” for any successful BI organization. If we think of people on the business side as “blue” and the people on the IT side as “red”, then “purple people” are people that have a mix of skills that enable them to be effective at bridging the gap between the two worlds. I spoke to Wayne afterwards and he elaborated on the idea:
“Purple people are a blend of business and IT – not blue in business or red in IT but a combination of both. These are both senior and junior level folks. At the senior level, some start in the business and end up in IT and then usually come back to the business where they run a business technology group that acts as an interface between the business and IT. (In the BI world I call these teams BOBI – business-oriented BI teams.) Some in IT become very conversant with the business and do a good job meeting business needs. These are directors of BI who interface with business executives more than their technical teams just about, to present budgets, roadmaps, funding requests, etc.
At the junior level, things are trickier, and not as effective. Most companies have business requirements analysts who interview business people, gather requirements, and translate those into specs for developers. I usually find there is a lot lost in translation with these junior level purple people.”
Another one of his key observations in the presentation was that from a BI architecture/organizational perspective, we can think of reporting as being a top-down process, with (we hope!) needs analysis, clearly defined specs, a process for building and moving data marts and reports into production, various controlling structures and so on.
Analysis, however, doesn’t really lend itself to this kind of approach – analysts may not know the questions that they want answered until they begin to delve into the data in a very ad-hoc kind of way. They want to quickly add data sources, join things together, and perform analysis that will lead to more questions, potentially the requirement for more data sources, and so on.
This leads to the business attempting to work around IT to get what they want, including bringing in tools that IT isn’t prepared to support. Analysis ends up being a volatile, bottom-up process, driven by the business, and the organization may struggle to keep it under control. IT fears chaos, but – to some degree – real analysis has a chaotic, or at least unpredictable, character. BI practice has to recognize the contrast in the very natures of reporting and analysis to be effective.
Wayne is a regular blogger and author of books and reports, such as Performance Dashboards: Measuring, Monitoring, and Managing Your Business. If you get the opportunity to hear Wayne speak take advantage of it – he delivers a lot of thought-provoking content that has application in the real world.
SQL Server and XML
Posted by Scott Andrews in Ottawa Events, SQL Server on April 19, 2010
I came away from Ottawa Code Camp with an interesting tidbit – the XML data storage capabilities of SQL Server. Although this feature has existed since SQL Server 2005, this was the first time I had actually seen it demonstrated. As virtually the entire Cognos 8 world is XML driven, this has some interesting possibilities. The XML data type can force incoming data to fit its defined XML schema in much the same way a table structure does in a relational database, but it also will store any XML data when no schema is defined. Data can be extracted from the XML data type as pure data or raw XML through the use of XML Query (known as XQuery) and it can be manipulated with XML Data Manipulation Language (XML-DML).
Is anyone out there using this feature or is this a little known extra hiding away under SQL Server’s many other features?
What to Expect from SQL Server 2008 R2
Posted by Scott Andrews in Ottawa Events, SQL Server on March 24, 2010
I attended last night’s meeting of the Ottawa SQL.net Professional Association where we received a presentation of Microsoft SQL Server 2008 R2 by Damir Bersinic. R2 is SQL Server’s forthcoming release which should be available in May 2010.
When I got home, my wife asked me “Why didn’t they just call it SQL Server 2010?” Typically a version indicator like this marks a minor release, but it does sound a little strange. It reminds me of a story told by a fellow BI consultant a few years ago in which he was grilled by a U.S. customs agent for traveling to the United States for SQL Server 2005 training (“But it’s 2007!” the agent protested).
Despite the odd moniker, this release does have some interesting features particularly for security and Business Intelligence. Here are some of the highlights I noted:
Security: Building on the ability to encrypt columns in SQL Server 2008, it is possible with R2 to encrypt the database mdb and log files with what is referred to as “transparent data encryption”. Specifically, this is to prevent anyone walking off your business site with a USB key loaded with a copy of your entire database.
BI: With an emphasis on self service features, the new BI enhancements allow business users to bring large scale data sets directly into Excel with a tool called PowerPivot for Excel. Using in-memory storage, this allows you to manipulate millions of rows in Excel very quickly and easily.
SQL Server 2008 R2 Parallel Data Warehouse Edition: A SQL Server edition specifically designed for extremely large scale data warehouses, to hold tens or hundreds of terabits of data.
Efficiency: SQL Server 2008 R2 has further improved page compression and data compression, allowing more data per page. This reduces the number of reads and writes required, making database performance faster.
Master Data Services: A SharePoint based application that manages business definitions and rules with respect to your data. This is intended to simplify the management of these definitions, especially as they change over time.
Dashboards: There are now customizable dashboards for both DBAs and report administrators to monitor performance, resource utilization and other environment statistics.
StreamInsight: A platform that allows you to develop Complex Event Processing (CEP) applications. It is like BizTalk but significantly faster.
The word is out that SharePoint will be the standard platform of the future Microsoft Business Intelligence. A SharePoint breakfast session will take place on April 22 in Ottawa, as well a number of other Canadian cities between April 19th and May 3rd.
It appears that in-memory storage/processing is becoming the new standard for Business Intelligence, as both IBM Cognos TM1 and Microsoft SQL Server PowerPivot for Excel are using it to great effect.
IBM Cognos Ottawa Users’ Group
Posted by Scott Andrews in Cognos, Ottawa Events on February 13, 2010
Yesterday I attended the first IBM Cognos Ottawa Users’ Group meeting held in more than 3 years. Following the presentations on emerging Cognos 8 technologies, there was a discussion of creating a steering committee for the group. It was agreed that the group should be neutral and user focused, and that it not be sales or IBM partner driven. As such, a number of IBM clients agreed to participate in the committee. So we should see more events upcoming in this forum, with a particular focus on IBM clients and their experiences with IBM Cognos products.
I will post additional information on future events as it becomes available. Anyone interested in participating in the steering committee of the IBM Cognos Ottawa Users’ Group can contact me at bi@andrewsinfotech.com.
MotioCI for Cognos Business Intelligence
Posted by Scott Andrews in Ottawa Events on February 3, 2010
I was at today’s presentation of MotioCI and my initial response is that every one of my Cognos clients needs to have this product. It offers a version control on your entire Cognos Business Intelligence environment, along with other key features such as regression and stress testing. As a consultant, I really like the idea of having a history of Cognos report changes – it gives you a credible record of what changes were made, when, and by whom. This can become a contentious issue when business users ask you where your report changes are, especially if they themselves accidentally overwrote them (reverting to a previous report version is also easily available in MotioCI).
I am looking forward to hearing about MotioCI training opportunities, which should be forthcoming. This is a powerful, extremely useful addition to the Cognos universe.
IBM Cognos Events
Posted by Scott Andrews in Cognos, Ottawa Events on January 31, 2010
There are two interesting IBM Cognos events upcoming in the next two weeks. First, there is the IBM Cognos Performance Breakout Day which will be held on February 3, 2010. I am particularly interested in learning more about MotioCI and IBM Cognos Analytic Applications, both of which have featured presentations at this event. The second IBM Cognos event is the IBM Cognos Users’ Group meeting, to be held on February 11, 2010.
I will write up a summary on these events after the fact to share what I have learned.