Hi all,
Just wondering if anyone has any good sources for Greyhound results data... and if anyones knows if there's a scraper similar to rpscrape tool on GitHub??
I've used rpscrape for a while now, and a greyhound version would be awesome
TIA
rpscrape - greyhounds??
https://www.gbgb.org.uk/racing/results/
Data is returned as JSON from callable API, i.e.
https://api.gbgb.org.uk/api/results/mee ... ing=415753
Put in a delay if performing in bulk as can get blocked by cloudflare
Data is returned as JSON from callable API, i.e.
https://api.gbgb.org.uk/api/results/mee ... ing=415753
Put in a delay if performing in bulk as can get blocked by cloudflare
- Brovashift
- Posts: 521
- Joined: Tue May 18, 2021 12:35 am
Hi, Thanks Paul...ODPaul82 wrote: ↑Sat Aug 17, 2024 10:39 pmhttps://www.gbgb.org.uk/racing/results/
Data is returned as JSON from callable API, i.e.
https://api.gbgb.org.uk/api/results/mee ... ing=415753
Put in a delay if performing in bulk as can get blocked by cloudflare
Can I download the data as JSON directly from the site, or have I got to write some Python to call the API??
I registered an account on gbgb but can see anything obvious...
Thanks
No need to register, I wrote a tool in VBA to download the results for each day based on the market ID's that were returned for that individual day. Never touched python (won't go into it, 30 years of VBA I've never seen the need), but the premise would be the sameBrovashift wrote: ↑Sun Aug 18, 2024 3:52 pm
Hi, Thanks Paul...
Can I download the data as JSON directly from the site, or have I got to write some Python to call the API??
I registered an account on gbgb but can see anything obvious...
Thanks
Fetch all of the markets for that day
Get the market ID's for that day
Extract the results from each market.
Take a look with developer tools in your browser for what is returned with Fetch/XHR data when accessing the pages. Extracting it through code is so so so much faster then processing with PowerPivot that people do (not that I'm knocking it, just I like stuff that extracts fast).
I can share the code I created if you want along with the MS Access DB but I've not touched it since April so whether it still works or not I have no idea. I've not followed up on what I was doing as no matter the analysis on end result it was ending in red (attempting to assign speed ratings to dogs based on prior performance).
- Brovashift
- Posts: 521
- Joined: Tue May 18, 2021 12:35 am
TBH I'm no Python whizz, its just what that rpscrape is built in and so have ventured into it a little bit when making alterations. I'm most familiar with C# and SQL, but have dabbled with VBA... and MS Access, not since college about 15 years agoODPaul82 wrote: ↑Sun Aug 18, 2024 9:43 pmNo need to register, I wrote a tool in VBA to download the results for each day based on the market ID's that were returned for that individual day. Never touched python (won't go into it, 30 years of VBA I've never seen the need), but the premise would be the sameBrovashift wrote: ↑Sun Aug 18, 2024 3:52 pm
Hi, Thanks Paul...
Can I download the data as JSON directly from the site, or have I got to write some Python to call the API??
I registered an account on gbgb but can see anything obvious...
Thanks
Fetch all of the markets for that day
Get the market ID's for that day
Extract the results from each market.
Take a look with developer tools in your browser for what is returned with Fetch/XHR data when accessing the pages. Extracting it through code is so so so much faster then processing with PowerPivot that people do (not that I'm knocking it, just I like stuff that extracts fast).
I can share the code I created if you want along with the MS Access DB but I've not touched it since April so whether it still works or not I have no idea. I've not followed up on what I was doing as no matter the analysis on end result it was ending in red (attempting to assign speed ratings to dogs based on prior performance).
Ye please can I take a look at your code & Access DB, it'll give me something to work from, as I am not ashamed to say that I am quite lazy . Have you got Google Drive?
I was looking at the trap stats here https://greyhoundstats.co.uk/track_stats.php and wanted to drill down into why, where, when do the dogs win from the least favourable trap%, by course. Thinking there might be a lay strategy in there somewhere, maybe.
That rpscrape project is good because it saves as a .csv file and then I can simply filter the results as desired in excel, easy peazy.
- Brovashift
- Posts: 521
- Joined: Tue May 18, 2021 12:35 am
Did you run off with my idea?ODPaul82 wrote: ↑Sun Aug 18, 2024 9:43 pm
I can share the code I created if you want along with the MS Access DB but I've not touched it since April so whether it still works or not I have no idea. I've not followed up on what I was doing as no matter the analysis on end result it was ending in red (attempting to assign speed ratings to dogs based on prior performance).
No, it's called being busy with life & trading so I just haven't had a chance to respond.
https://we.tl/t-HCYZEm5Vvj
Uploaded it to WeTransfer
As I've no further interest in it I won't be giving support around the code
modHTTPExtract would be the key one for scraping the data from GBGB
- Brovashift
- Posts: 521
- Joined: Tue May 18, 2021 12:35 am
Thanks, I'll take a look laterODPaul82 wrote: ↑Mon Aug 26, 2024 7:19 amNo, it's called being busy with life & trading so I just haven't had a chance to respond.
https://we.tl/t-HCYZEm5Vvj
Uploaded it to WeTransfer
As I've no further interest in it I won't be giving support around the code
modHTTPExtract would be the key one for scraping the data from GBGB
Can you help with this by any chance;
viewtopic.php?t=14395&start=120
I seem to be having the same issue with most of there versions
Think I'm still using Windows excel 2007, not sure if that's the problem