René's URL Explorer Experiment


Title: Load artificial hes csvs into duckdb tables by nhsbsa-alijo · Pull Request #5 · NHSDigital/RAP_example_pipeline_python · GitHub

Open Graph Title: Load artificial hes csvs into duckdb tables by nhsbsa-alijo · Pull Request #5 · NHSDigital/RAP_example_pipeline_python

X Title: Load artificial hes csvs into duckdb tables by nhsbsa-alijo · Pull Request #5 · NHSDigital/RAP_example_pipeline_python

Description: Adds functionality to the get_data.py script and utils/data_connections.py to load csvs extracted from the artificial HES zip file into duckdb tables. These can be queried using SQL syntax or loaded into pandas dataframes (you can even write SQL to run on pandas dataframes! https://duckdb.org/2021/05/14/sql-on-pandas.html)

Open Graph Description: Adds functionality to the get_data.py script and utils/data_connections.py to load csvs extracted from the artificial HES zip file into duckdb tables. These can be queried using SQL syntax or loade...

X Description: Adds functionality to the get_data.py script and utils/data_connections.py to load csvs extracted from the artificial HES zip file into duckdb tables. These can be queried using SQL syntax or loade...

Opengraph URL: https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:5811b588-6c8d-fc8a-6604-100942398bb2
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idD120:3EE845:5A0C3E2:7DB8B8E:6A4F956F
html-safe-nonce1fb3b718d400df18d60fc56e2ad0ce9888397dfa5679ae2e8215b116a99cccd9
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJEMTIwOjNFRTg0NTo1QTBDM0UyOjdEQjhCOEU6NkE0Rjk1NkYiLCJ2aXNpdG9yX2lkIjoiOTA3NzMyNTExMTcxMTczMzEwMyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac1a8caa27fc742725b9ddda1a73bd971f96dbfc2cffae6071e15fa95e91b3519e
hovercard-subject-tagpull_request:1422659311
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files
twitter:imagehttps://avatars.githubusercontent.com/u/101199560?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/101199560?s=400&v=4
og:image:altAdds functionality to the get_data.py script and utils/data_connections.py to load csvs extracted from the artificial HES zip file into duckdb tables. These can be queried using SQL syntax or loade...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneb92d11c0aa4a77d54ef4af1078b6a15fb5a70a215b30c4ecf28889d5a8e656d9
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/NHSDigital/RAP_example_pipeline_python git https://github.com/NHSDigital/RAP_example_pipeline_python.git
octolytics-dimension-user_id6683590
octolytics-dimension-user_loginNHSDigital
octolytics-dimension-repository_id662117790
octolytics-dimension-repository_nwoNHSDigital/RAP_example_pipeline_python
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id662117790
octolytics-dimension-repository_network_root_nwoNHSDigital/RAP_example_pipeline_python
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release4b249b445842943ed31549e027f57a8ade9881ed
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FNHSDigital%2FRAP_example_pipeline_python%2Fpull%2F5%2Ffiles
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/open-source/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/open-source/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FNHSDigital%2FRAP_example_pipeline_python%2Fpull%2F5%2Ffiles
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=NHSDigital%2FRAP_example_pipeline_python
Reloadhttps://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files
Reloadhttps://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files
Reloadhttps://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files
Please reload this pagehttps://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files
NHSDigital https://github.com/NHSDigital
RAP_example_pipeline_pythonhttps://github.com/NHSDigital/RAP_example_pipeline_python
Notifications https://github.com/login?return_to=%2FNHSDigital%2FRAP_example_pipeline_python
Fork 4 https://github.com/login?return_to=%2FNHSDigital%2FRAP_example_pipeline_python
Star 8 https://github.com/login?return_to=%2FNHSDigital%2FRAP_example_pipeline_python
Code https://github.com/NHSDigital/RAP_example_pipeline_python
Issues 0 https://github.com/NHSDigital/RAP_example_pipeline_python/issues
Pull requests 2 https://github.com/NHSDigital/RAP_example_pipeline_python/pulls
Actions https://github.com/NHSDigital/RAP_example_pipeline_python/actions
Projects https://github.com/NHSDigital/RAP_example_pipeline_python/projects
Security and quality 0 https://github.com/NHSDigital/RAP_example_pipeline_python/security
Insights https://github.com/NHSDigital/RAP_example_pipeline_python/pulse
Code https://github.com/NHSDigital/RAP_example_pipeline_python
Issues https://github.com/NHSDigital/RAP_example_pipeline_python/issues
Pull requests https://github.com/NHSDigital/RAP_example_pipeline_python/pulls
Actions https://github.com/NHSDigital/RAP_example_pipeline_python/actions
Projects https://github.com/NHSDigital/RAP_example_pipeline_python/projects
Security and quality https://github.com/NHSDigital/RAP_example_pipeline_python/security
Insights https://github.com/NHSDigital/RAP_example_pipeline_python/pulse
Sign up for GitHub https://github.com/signup?return_to=%2FNHSDigital%2FRAP_example_pipeline_python%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2FNHSDigital%2FRAP_example_pipeline_python%2Fissues%2Fnew%2Fchoose
nhsbsa-alijohttps://github.com/nhsbsa-alijo
mainhttps://github.com/NHSDigital/RAP_example_pipeline_python/tree/main
aj_query_via_duckdbhttps://github.com/NHSDigital/RAP_example_pipeline_python/tree/aj_query_via_duckdb
Conversation 0 https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5
Commits 3 https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/commits
Checks 0 https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/checks
Files changed https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files
Please reload this pagehttps://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files
Load artificial hes csvs into duckdb tables https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files#top
Show all changes 3 commits https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files
f917ea7 Add steps to load csvs into duckdb tables nhsbsa-alijo Jul 6, 2023 https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/commits/f917ea79024ac3c4f6fc53b575d120b890187579
8f5eb33 Refactor data connection functions nhsbsa-alijo Jul 6, 2023 https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/commits/8f5eb3335e319334e34b9486a7c27d6afd61f0d8
592fbf6 Fix duckdb pandas sampling issues nhsbsa-alijo Jul 6, 2023 https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/commits/592fbf6498d1c7783fba57678479b337e0d530a6
Clear filters https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files
Please reload this pagehttps://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files
Please reload this pagehttps://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files
.gitignore https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files#diff-bc37d034bad564583790a46f19d807abfe519c5671395fd494d8cce506c42947
get_data.py https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files#diff-09258f726d8454e88cc3af9733699109662cf7e61b0219cd6111bb128d607c76
data_connections.py https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files#diff-f907977b0e232d135d521ade60cc73b08554c9296b7f81a37184ec22d79afb5c
.gitignorehttps://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files#diff-bc37d034bad564583790a46f19d807abfe519c5671395fd494d8cce506c42947
View file https://github.com/NHSDigital/RAP_example_pipeline_python/blob/592fbf6498d1c7783fba57678479b337e0d530a6/.gitignore
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/{{ revealButtonHref }}
https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files#diff-bc37d034bad564583790a46f19d807abfe519c5671395fd494d8cce506c42947
src/data_ingestion/get_data.pyhttps://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files#diff-09258f726d8454e88cc3af9733699109662cf7e61b0219cd6111bb128d607c76
View file https://github.com/NHSDigital/RAP_example_pipeline_python/blob/592fbf6498d1c7783fba57678479b337e0d530a6/src/data_ingestion/get_data.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/{{ revealButtonHref }}
src/utils/data_connections.pyhttps://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/files#diff-f907977b0e232d135d521ade60cc73b08554c9296b7f81a37184ec22d79afb5c
View file https://github.com/NHSDigital/RAP_example_pipeline_python/blob/592fbf6498d1c7783fba57678479b337e0d530a6/src/utils/data_connections.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/NHSDigital/RAP_example_pipeline_python/pull/5/{{ revealButtonHref }}
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.