rpscrape - greyhounds??

We've gone to the dogs.
Post Reply
User avatar
Brovashift
Posts: 522
Joined: Tue May 18, 2021 12:35 am

Hi all,

Just wondering if anyone has any good sources for Greyhound results data... and if anyones knows if there's a scraper similar to rpscrape tool on GitHub??

I've used rpscrape for a while now, and a greyhound version would be awesome :)

TIA
User avatar
ODPaul82
Posts: 737
Joined: Sun May 08, 2011 6:32 am
Location: Knebworth, Herts

https://www.gbgb.org.uk/racing/results/

Data is returned as JSON from callable API, i.e.
https://api.gbgb.org.uk/api/results/mee ... ing=415753

Put in a delay if performing in bulk as can get blocked by cloudflare
User avatar
Brovashift
Posts: 522
Joined: Tue May 18, 2021 12:35 am

ODPaul82 wrote:
Sat Aug 17, 2024 10:39 pm
https://www.gbgb.org.uk/racing/results/

Data is returned as JSON from callable API, i.e.
https://api.gbgb.org.uk/api/results/mee ... ing=415753

Put in a delay if performing in bulk as can get blocked by cloudflare
Hi, Thanks Paul...

Can I download the data as JSON directly from the site, or have I got to write some Python to call the API??

I registered an account on gbgb but can see anything obvious... :?:

Thanks
User avatar
ODPaul82
Posts: 737
Joined: Sun May 08, 2011 6:32 am
Location: Knebworth, Herts

Brovashift wrote:
Sun Aug 18, 2024 3:52 pm

Hi, Thanks Paul...

Can I download the data as JSON directly from the site, or have I got to write some Python to call the API??

I registered an account on gbgb but can see anything obvious... :?:

Thanks
No need to register, I wrote a tool in VBA to download the results for each day based on the market ID's that were returned for that individual day. Never touched python (won't go into it, 30 years of VBA I've never seen the need), but the premise would be the same

Fetch all of the markets for that day
Get the market ID's for that day
Extract the results from each market.

Take a look with developer tools in your browser for what is returned with Fetch/XHR data when accessing the pages. Extracting it through code is so so so much faster then processing with PowerPivot that people do (not that I'm knocking it, just I like stuff that extracts fast).

I can share the code I created if you want along with the MS Access DB but I've not touched it since April so whether it still works or not I have no idea. I've not followed up on what I was doing as no matter the analysis on end result it was ending in red (attempting to assign speed ratings to dogs based on prior performance).
User avatar
Brovashift
Posts: 522
Joined: Tue May 18, 2021 12:35 am

ODPaul82 wrote:
Sun Aug 18, 2024 9:43 pm
Brovashift wrote:
Sun Aug 18, 2024 3:52 pm

Hi, Thanks Paul...

Can I download the data as JSON directly from the site, or have I got to write some Python to call the API??

I registered an account on gbgb but can see anything obvious... :?:

Thanks
No need to register, I wrote a tool in VBA to download the results for each day based on the market ID's that were returned for that individual day. Never touched python (won't go into it, 30 years of VBA I've never seen the need), but the premise would be the same

Fetch all of the markets for that day
Get the market ID's for that day
Extract the results from each market.

Take a look with developer tools in your browser for what is returned with Fetch/XHR data when accessing the pages. Extracting it through code is so so so much faster then processing with PowerPivot that people do (not that I'm knocking it, just I like stuff that extracts fast).

I can share the code I created if you want along with the MS Access DB but I've not touched it since April so whether it still works or not I have no idea. I've not followed up on what I was doing as no matter the analysis on end result it was ending in red (attempting to assign speed ratings to dogs based on prior performance).
TBH I'm no Python whizz, its just what that rpscrape is built in and so have ventured into it a little bit when making alterations. I'm most familiar with C# and SQL, but have dabbled with VBA... and MS Access, not since college about 15 years ago :lol:
Ye please can I take a look at your code & Access DB, it'll give me something to work from, as I am not ashamed to say that I am quite lazy :D. Have you got Google Drive?

I was looking at the trap stats here https://greyhoundstats.co.uk/track_stats.php and wanted to drill down into why, where, when do the dogs win from the least favourable trap%, by course. Thinking there might be a lay strategy in there somewhere, maybe.
That rpscrape project is good because it saves as a .csv file and then I can simply filter the results as desired in excel, easy peazy.
User avatar
Brovashift
Posts: 522
Joined: Tue May 18, 2021 12:35 am

ODPaul82 wrote:
Sun Aug 18, 2024 9:43 pm

I can share the code I created if you want along with the MS Access DB but I've not touched it since April so whether it still works or not I have no idea. I've not followed up on what I was doing as no matter the analysis on end result it was ending in red (attempting to assign speed ratings to dogs based on prior performance).
Did you run off with my idea? :lol:
User avatar
ODPaul82
Posts: 737
Joined: Sun May 08, 2011 6:32 am
Location: Knebworth, Herts

Brovashift wrote:
Wed Aug 21, 2024 2:12 pm
Did you run off with my idea? :lol:
No, it's called being busy with life & trading so I just haven't had a chance to respond.
https://we.tl/t-HCYZEm5Vvj
Uploaded it to WeTransfer
As I've no further interest in it I won't be giving support around the code
modHTTPExtract would be the key one for scraping the data from GBGB
User avatar
Brovashift
Posts: 522
Joined: Tue May 18, 2021 12:35 am

ODPaul82 wrote:
Mon Aug 26, 2024 7:19 am
Brovashift wrote:
Wed Aug 21, 2024 2:12 pm
Did you run off with my idea? :lol:
No, it's called being busy with life & trading so I just haven't had a chance to respond.
https://we.tl/t-HCYZEm5Vvj
Uploaded it to WeTransfer
As I've no further interest in it I won't be giving support around the code
modHTTPExtract would be the key one for scraping the data from GBGB
Thanks, I'll take a look later ;)

Can you help with this by any chance;
viewtopic.php?t=14395&start=120

I seem to be having the same issue with most of there versions :?:
Think I'm still using Windows excel 2007, not sure if that's the problem
User avatar
ODPaul82
Posts: 737
Joined: Sun May 08, 2011 6:32 am
Location: Knebworth, Herts

Will update it when can, US open in full swing so days are pretty full with day job followed by that.
Hadn't seen any of the prior messages about it, apologies.
Fugazi
Posts: 624
Joined: Wed Jan 10, 2024 7:20 pm

I posted a model and scraper not long ago. With the model was every dog that ever raced and associated date until around May this year. Will need some knowledge/tampering to set it up
tico
Posts: 9
Joined: Fri Sep 20, 2024 9:18 pm

Hi,
Is the tool still available ? .I tried downloading it but it has expired .It looks really interesting :)
Tico
Post Reply

Return to “Trading Greyhound racing”