Data Refining Workshop

[ebeshero]

• Send the spreadsheet of MSS

• Subset of data (perhaps all historical people) from SI for VIAF and for occupations.

• I will work on "cross-walking" back from TSV to XML via ID transform.

@mbolam

[ebeshero]

By SUNDAY!

[ebeshero]

@mbolam Yikes--looks like I missed a deadline to deliver files to you. But I'm also wondering if we've actually figured it out: Would you like to work with the Digital Mitford Site index? You can download the always-current one here:

http://digitalmitford.org/si.xml

There's also the giant spreadsheet of Mitford MSS locations: Instead of pushing this to GitHub, here's a direct link to it at its Box home .

Let me know what you need...I'm back in Pittsburgh again at Pitt tomorrow if you'd like to meet and chat a bit.

[mbolam]

@ebeshero -- You had volunteered to extract tabular data (CSV) out of the si.xml, specifically the historical people section, I believe.

[ebeshero]

@mbolam That’s right—will do this AM!

[ebeshero]

@mbolam I've made a TSV file from the Digital Mitford Site Index here:
https://github.com/ebeshero/DigMitCS/tree/master/data-cleaning

Basically it includes on each line of a tab-separated set the following data on each historical person:

• xml:id
• a joined list of names associated with this person
• a joined list of occupations associated with this person
• a VIAF entry if we currently have one (we don't for everyone)

I can include more, but the need to make joined lists (since each entry can contain one or more persNames as well as one or more occupations) struck me as potentially complicating things, so I figured this would be a decent start for us! Let me know how this looks and sorry for the delay!