Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
mastodon.ie is one of the many independent Mastodon servers you can use to participate in the fediverse.
Irish Mastodon - run from Ireland, we welcome all who respect the community rules and members.

Administered by:

Server stats:

1.8K
active users

mastodon.ie: AboutProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.7

#dataproduct

0 posts0 participants0 posts today
Mike Williamson<p>The Treasury Board's policy suite is conceptually a giant graph structure, but is frustratingly resistant to automated analysis.</p><p>Some annoyances:</p><p>The policy suite straddles tbs-sct.gc.ca and canada.ca and policies often draw their authorities from material on laws-lois.justice.gc.ca</p><p>There is frustratingly little common structure you can rely on. If you think you found a structure, you just need to see a few more policies</p><p>Links between policies or to laws rarely link to relevant sections</p><p>Only a few policies have an XML data representation, most are available only as HTML, making web scraping the most reliable approach</p><p>Markers indicating sections, clauses etc. are not consistent across HTML documents making web scraping extremely annoying</p><p>Multiple requirements often occur in a single ("and")</p><p>Enabling programmatic analysis of policy would be broadly valuable both inside and outside government.</p><p>This should be an <a href="https://infosec.exchange/tags/opendata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>opendata</span></a> <a href="https://infosec.exchange/tags/dataproduct" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dataproduct</span></a> but it seems like these documents are largely treated like marketing material: if it looks OK in the browser it's done.</p><p><a href="https://infosec.exchange/tags/gcdigital" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>gcdigital</span></a></p>
💧🌏 Greg Cocks<p>Canadian Hydrospatial Network (CHN) [release]<br>--<br><a href="https://natural-resources.canada.ca/the-office-the-chief-scientist/science-and-research/geomatics/topographic-tools-and-data/canadian-hydrospatial-network/25283" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">natural-resources.canada.ca/th</span><span class="invisible">e-office-the-chief-scientist/science-and-research/geomatics/topographic-tools-and-data/canadian-hydrospatial-network/25283</span></a> &lt;-- link to release<br>--<br><a href="https://open.canada.ca/data/en/dataset/ae385105-e48c-4b54-bd0f-dfb7303301cb" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">open.canada.ca/data/en/dataset</span><span class="invisible">/ae385105-e48c-4b54-bd0f-dfb7303301cb</span></a> &lt;-- CHN home page<br>----<br>[It will be wonderful to see how this and the USGS's 3DHP in the USA integrate: <a href="https://www.usgs.gov/3DHP" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="">usgs.gov/3DHP</span><span class="invisible"></span></a>]<br><a href="https://techhub.social/tags/GIS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GIS</span></a> <a href="https://techhub.social/tags/spatial" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>spatial</span></a> <a href="https://techhub.social/tags/mapping" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>mapping</span></a> <a href="https://techhub.social/tags/water" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>water</span></a> <a href="https://techhub.social/tags/hydrology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>hydrology</span></a> <a href="https://techhub.social/tags/representation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>representation</span></a> <a href="https://techhub.social/tags/CHN" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>CHN</span></a> <a href="https://techhub.social/tags/canada" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>canada</span></a> <a href="https://techhub.social/tags/canadian" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>canadian</span></a> <a href="https://techhub.social/tags/national" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>national</span></a> <a href="https://techhub.social/tags/chn" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>chn</span></a> <a href="https://techhub.social/tags/hydrospatial" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>hydrospatial</span></a> <a href="https://techhub.social/tags/network" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>network</span></a> <a href="https://techhub.social/tags/representation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>representation</span></a> <a href="https://techhub.social/tags/vector" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>vector</span></a> <a href="https://techhub.social/tags/raster" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>raster</span></a> <a href="https://techhub.social/tags/dataproduct" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dataproduct</span></a> <a href="https://techhub.social/tags/opendata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>opendata</span></a> <a href="https://techhub.social/tags/surfacewater" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>surfacewater</span></a> <a href="https://techhub.social/tags/lakes" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lakes</span></a> <a href="https://techhub.social/tags/rivers" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>rivers</span></a> <a href="https://techhub.social/tags/streams" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>streams</span></a> <a href="https://techhub.social/tags/watersheds" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>watersheds</span></a> <a href="https://techhub.social/tags/connections" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>connections</span></a> <a href="https://techhub.social/tags/people" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>people</span></a> <a href="https://techhub.social/tags/infrastructure" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>infrastructure</span></a> <a href="https://techhub.social/tags/plants" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>plants</span></a> <a href="https://techhub.social/tags/animals" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>animals</span></a> <a href="https://techhub.social/tags/environment" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>environment</span></a> <a href="https://techhub.social/tags/model" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>model</span></a> <a href="https://techhub.social/tags/modeling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>modeling</span></a> <a href="https://techhub.social/tags/spatialanalysis" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>spatialanalysis</span></a> <a href="https://techhub.social/tags/spatiotemporal" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>spatiotemporal</span></a> <a href="https://techhub.social/tags/management" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>management</span></a> <a href="https://techhub.social/tags/cartography" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>cartography</span></a> <a href="https://techhub.social/tags/3dhp" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>3dhp</span></a> <a href="https://techhub.social/tags/NaturalResourcesCanada" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>NaturalResourcesCanada</span></a><br>@NRCAN</p>
RIch Miller<p>I've been too long without posting.&nbsp;There's been a lot going on in data engineering, the modern data stack, the business(es) of data, …&nbsp;not to mention FTX and ChatGPT (but, of course, you already know about all of that.)<br><a href="https://medium.com/@rhm2k/resonance-calendar-for-50-2022-3341b2b94339" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">medium.com/@rhm2k/resonance-ca</span><span class="invisible">lendar-for-50-2022-3341b2b94339</span></a></p><p><a href="https://ioc.exchange/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataEngineering</span></a> <a href="https://ioc.exchange/tags/DataProduct" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataProduct</span></a> <a href="https://ioc.exchange/tags/DataEconomics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataEconomics</span></a></p>
RIch Miller<p>"A Data Product is set of prepared data or information (and hence specifically not raw data) that is ready to be consumed by a wide set of consumers."</p><p>Willem Koenders provides insights into one of the fundamental concepts of contemporary data engineering.</p><p><a href="https://ioc.exchange/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataEngineering</span></a> <br><a href="https://ioc.exchange/tags/DataProduct" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataProduct</span></a></p><p><a href="https://medium.com/@koendit/whats-the-big-deal-about-data-products-26ac347b7d7a" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">medium.com/@koendit/whats-the-</span><span class="invisible">big-deal-about-data-products-26ac347b7d7a</span></a></p>
ExploreLive feeds
About