Browsing articles in "Open Data"

Join the live streaming Cloud Field Day 1 #CFD1

Sep 14, 2016   //   by Karen Lopez   //   Analytics, Blog, Cloud, Data, DLBlog, Events, Open Data, Speaking  //  1 Comment

I’m a delegate at the inaugural Cloud Field Day. We’ll be live streaming all the events, including our podcasts today and tomorrow.


Podcast on Is Data Boring?

Podcast on Is Cloud Tech the solution or is it the Cloud Process?

Podcast on Is DevOps A Load of Crap?

Visit with Cisco

Visit with Druva

Visit with Scality

Visit with Docker


Join Me at Enterprise Data World and Save $200 + $200

Conference Session Photo

I’ve been attending Enterprise Data World for more than 15 years.  This event, focused on data architectures, data management, data modeling data governance and other great enterprise-class methods is part technical training and part revival for data professionals.  It’s just that good.

This year the big bash is being held in Austin, TX, a thriving tech-oriented community, 27-April to 1 May.  And this year’s theme is “The Transformation to Data-Driven Business Starts Here.”

And right now there’s a $200 Early Bird Discount going…plus if you use coupon code “DATACHICK” you can save $200 more on a multi-day registration or fifty bucks on a one day pass.  There.  I just saved you $400.  And no, I get no kickbacks with this discount code.  I don’t need them.  I need you to be at this event, sharing your knowledge and meeting other data professionals. I need you to be part of the community of data professionals.

Top 10 Reasons You Need to Go to EDW 2014

  1. Data is HOT HOT HOT.  I deemed 2013 The Year of Data and I see no signs that organizations are going to back to software-is-everything thinking.  2014 is still going to be a year full of data. There’s even an executive, invitation-only CDOvision even co-located.
  2. Not Just Bullet Points.  There are over 20 hours of scheduled networking events for you to chat with other data-curious people.  Chatting with other data professionals is my favourite part of this event.  Bring your business cards…er… .vcs contact file.
  3. Lots of Expertise. Not just data celebrities, but also other data professionals with thousands of hours of hands-on experiences, sharing their use cases around data.  And not just data modeling.  Big Data.  Analytics.  Methods.  Tools.  Open Data.  Governance. NoSQL. SQL. RDBMS. Fun.
  4. Certifications.  You can take advantage of the Pay-Only-If-You-Pass option for the CDMP on-site certification testing.
  5. Workshops. I’m doing a half day tutorial on Driving Development Projects with Enterprise Data Models.  I’ll be talking about how data models fit within real-life, practical, get-stuff-done development projects. No ivory towers here.
  6. SIGs.  There are special interest groups on data modeling products, industries and methods. You can meet people just like you an share your tips and tricks for data lovin.  I will be leading the ER/Studio SIG.
  7. Ice Cream.  This conference has a tradition of the ice cream break on the exhibit floor.  Nice ice cream, even.
  8. Austin. Austin is one of the more vibrant cities in Texas.  So cool, it even has a Stevie Ray Vaughan statue. Museums, Theatres, indoor golf, clubs.  There’s a reason why SxSW is held here.
  9. Vendors. Yes, we love them, too.  Meet the product teams of the makers of the tools you use every day.  Or meet new teams and ask for a demo.  They are good people.
  10. Love Your Data.  There’s no better way to show your love than to network with other data professionals and learn from industry leaders.

Come learn how to help your organization love data better.  You might even see me in a lightning talk holding a martini.  Or taking impromptu pics of @data_model and other data professionals.  Or debating data management strategy with people from around the globe.  In other words, talking data. With people who love their data.  Join us.

Ethics.Data.Gov – Where Open Data is Taking Us

Mar 15, 2012   //   by Karen Lopez   //   Blog, Data, Data Visualization, Open Data  //  No Comments

I came across this video via Twitter from my friend Jim Hendler (blog | @jahendler).  It’s a walkthrough by US Deputy Chief Technology Officer Chris Vein of

Walkthrough of Ethics.Data.Gov


This website brings together key open data sets such as White House visitors,lobbying, campaign donations, etc. As the URL shows, it’s a sub site of the over all US open data project,  You can see in the image below the datasets that comprise the Ethics data site: datasets list

The data is available for download and the website offers some nifty ways of working with, visualizing, and embedding the data. For instance, I’ve embedded the White House Visitor data right here. Go ahead, do some searching or filtering, right here.

Powered by Socrata


You can change the column order by using the Manage button:

Show and hide columns

You can set up some fairly decent filters (is, contains, etc.) on the columns, too.  Here are the visitors named Karen Lopez:

Filter Columns

That’s not me.  (I seem to recall that I am mayor of the Lincoln Bedroom on Foursquare, though.) This is the problem with trying to use something like First Name and Last Name as a primary key.  My data does show up in the Federal Campaign donations list, though.  Only one donation…my other donation was returned to me because "Canadians can’t donate to US campaigns".  Unfortunately for that candidate, they assumed that I was Canadian based on my residency, not my citizenship.  They lost the money, but the other campaign got to keep my money.  The entire world is one big data modeling problem, I tell ya.  Get your semantics and your syntax right and you can take over the world.  Or at least the US.

The real power in open data is being able to find correlations.  As Deputy CTO Vein mentions, one could match up the data from the White House visitors, lobbyists and campaign donations to see if you find any matches.  That’s not bad, it’s just more information.  This is tough to pull off with any certainty, though, due to that dang primary key issue I mentioned above.  What might help this? URIs.  Or some other way of uniquely identifying people and organizations.

To cross match data, you’ll need to use one of the Export methods of using the API (Socrata ) or download the data to your own tools.

Data is available for download in these formats:

Download As

You can also discuss the datasets right on the site (registration required).  There are only 7 datasets that are part of this ethics website, but the data stewards are eager to find out what datasets you’d like to see added.  I’d also like to hear what data you think should be part of an ethics website focused on data. I’m thinking:

  • Expenditures that required extra approval/oversight
  • Travel data (who went where an why)

Some of the criticism that I’ve heard about is that there are too few datasets or that so much more could be provided.  I’ve even heard complaints about money being spent on this service.  As Tony Clement, Canadian MP and President of the Treasury Board (site | @tonyclementCPC ) said recently about the Canadian open data initiatives: open data is about transparency.  We can’t wait until we have all the data, in a perfect format, to share it.  He also mentioned that open data is saving the Canadian Government in significantly reduced costs for Freedom of Information Access requests.  Think about it.  What open data will become is self-serve FOIA.  No waiting around for someone to spend weeks or months to find some data, then thousands of dollars to prepare and provide it.

I’m also hoping that the move to open data will allow government data architects to influence good data management practices.  Exposing the data to sunshine is going to allow us, the people who fund the data collection and processing, to point out where the data is poor quality.  The usability and ability to integrate data sets is going to be key in making it useful.

I’m thinking that I’d like to use some of these sets and others from for some upcoming demos.

Subscribe via E-mail

Use the link below to receive posts via e-mail. Unsubscribe at any time. Subscribe to by Email