I’ve had various stabs over the years at tools that will dump out the whole connector space, or just the pending exports, and convert it into a CSV file for easy analysis. They often fall down on two things: the XML file produced by CSExport can be very large (way too big for Get-Content), and the whole file is all on one line. I’ve now taken the approach of breaking the XML out into multiple files which I can then parse easily.<\/p>\n
<\/p>\n
Step one is to tackle the single line problem. Because the XML file produced by CSExport is all on a single line I can’t use a StreamReader to read it line by line. I looked into various other reading options (chunks and characters), but eventually decided to use an XSLT stylesheet to insert carriage retuns between each <cs-object> node.<\/p>\n
The stylesheet looks like this (saved as CSExportSplitLines.xslt):<\/p>\n
\n<?xml version=\"1.0\"?>\r\n\r\n<xsl:stylesheet version=\"1.0\" xmlns:xsl=\"http:\/\/www.w3.org\/1999\/XSL\/Transform\">\r\n <xsl:template match=\"\/\/cs-object\">\r\n <xsl:copy-of select=\".\"\/>\r\n\t<xsl:text> <\/xsl:text>\r\n <\/xsl:template>\r\n<\/xsl:stylesheet>\r\n<\/pre>\n<\/blockquote>\nNext I use PowerShell to create a copy of the CSExport file with the carriage returns added:<\/p>\n
$XSLTPath = “CSExportSplitLines.xslt”
\n$SourceFile = “AD.XML”
\n$TargetFile = “AD_SplitLines.XML”<\/p>\n$xslt = new-object system.xml.xsl.XslTransform
\n$xslt.load($XSLTPath)
\n$xslt.Transform($SourceFile,$TargetFile)<\/p><\/blockquote>\nThen it’s a simple matter to read the new XML file one line at a time, writing out a temporary file for each one (note the snippet below uses $TempFolder which must be defined):<\/p>\n
\n$reader = [System.IO.File]::OpenText($TargetFile)\r\n$i = 0\r\ndo {\r\n $line = $reader.ReadLine()\r\n $line | out-file ($TempFolder + \"\\\" + $i.ToString().PadLeft(10,'0') + \".XML\")\r\n $i += 1\r\n} until ($reader.EndOfStream)\r\n\r\n$reader.Close()\r\nRemove-Item $TargetFile<\/pre>\n<\/blockquote>\nDepending on the size of your CSExport file this may produce a lot of files! But they’re all small and easy enough to loop through and load with Get-Content.<\/p>\n","protected":false},"excerpt":{"rendered":"
I’ve had various stabs over the years at tools that will dump out the whole connector space, or just the pending exports, and convert it into a CSV file for easy analysis. They often fall down on two things: the XML file produced by CSExport can be very large (way too big for Get-Content), and…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":[]},"categories":[42,60,58,23],"tags":[],"class_list":["post-2867","post","type-post","status-publish","format-standard","hentry","category-fim-2010","category-fim-2010-r2","category-fim-sync-service","category-powershell"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/pkp1o-Kf","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.wapshere.com\/missmiis\/wp-json\/wp\/v2\/posts\/2867","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.wapshere.com\/missmiis\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.wapshere.com\/missmiis\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.wapshere.com\/missmiis\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.wapshere.com\/missmiis\/wp-json\/wp\/v2\/comments?post=2867"}],"version-history":[{"count":3,"href":"https:\/\/www.wapshere.com\/missmiis\/wp-json\/wp\/v2\/posts\/2867\/revisions"}],"predecessor-version":[{"id":2870,"href":"https:\/\/www.wapshere.com\/missmiis\/wp-json\/wp\/v2\/posts\/2867\/revisions\/2870"}],"wp:attachment":[{"href":"https:\/\/www.wapshere.com\/missmiis\/wp-json\/wp\/v2\/media?parent=2867"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.wapshere.com\/missmiis\/wp-json\/wp\/v2\/categories?post=2867"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.wapshere.com\/missmiis\/wp-json\/wp\/v2\/tags?post=2867"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}