Hi,
Is it possible to do this with Proform daily race guides?
Thanks
Power Query - Example Spreadsheets (Indexed by Sport)
- MemphisFlash
- Posts: 2166
- Joined: Fri May 16, 2014 10:12 pm
- Location: Leicester
do you have a webpage link and we can have a look at what data your after.
If it's a thing you pay for on subscription then i can't as i don't pay for stuff like that.
If it's a thing you pay for on subscription then i can't as i don't pay for stuff like that.
-
- Posts: 3219
- Joined: Thu Oct 24, 2019 8:25 am
- Location: Newport
Hi,
While I think all this stuff is excellent, people need to be careful as isn't scraping of data illegal ?
Cheers,
While I think all this stuff is excellent, people need to be careful as isn't scraping of data illegal ?
Cheers,
-
- Posts: 88
- Joined: Wed Jan 22, 2020 1:13 pm
web scraping is like going manually by yourself on a website and noting down the info, except you have a bot that's doing it. nothing illegal IMOArchery1969 wrote: ↑Wed Dec 02, 2020 2:41 pmHi,
While I think all this stuff is excellent, people need to be careful as isn't scraping of data illegal ?
Cheers,
- paspuggie48
- Posts: 640
- Joined: Thu Jun 20, 2013 9:22 am
- Location: South-West
AgreeVladimir CC wrote: ↑Wed Dec 02, 2020 5:51 pmweb scraping is like going manually by yourself on a website and noting down the info, except you have a bot that's doing it. nothing illegal IMOArchery1969 wrote: ↑Wed Dec 02, 2020 2:41 pmHi,
While I think all this stuff is excellent, people need to be careful as isn't scraping of data illegal ?
Cheers,
-
- Posts: 3219
- Joined: Thu Oct 24, 2019 8:25 am
- Location: Newport
It may not be clear cut....
The legal position in the UK:
While web scraping is itself not illegal, there are certain instances where it may become illegal depending on how and what the scraper does with the data gathered.
The two most common claims that can be brought against data scrapers are breach of contract and IP infringement (specifically, database right infringement). Depending on the precise circumstances, it is possible that a data scraper could also infringe copyright or trade mark rights, data protection legislation and/or contravene the Computer Misuse Act 1990.
The legal position in the UK:
While web scraping is itself not illegal, there are certain instances where it may become illegal depending on how and what the scraper does with the data gathered.
The two most common claims that can be brought against data scrapers are breach of contract and IP infringement (specifically, database right infringement). Depending on the precise circumstances, it is possible that a data scraper could also infringe copyright or trade mark rights, data protection legislation and/or contravene the Computer Misuse Act 1990.
-
- Posts: 1074
- Joined: Fri Nov 20, 2015 9:38 am
I think it depends on the websites Terms of Service (which you agree to by using their site) & specifically whether you publish it. Plenty of lawyers out there who will happily send you a cease & desist letter and damages request.paspuggie48 wrote: ↑Thu Dec 03, 2020 9:42 amAgreeVladimir CC wrote: ↑Wed Dec 02, 2020 5:51 pmweb scraping is like going manually by yourself on a website and noting down the info, except you have a bot that's doing it. nothing illegal IMOArchery1969 wrote: ↑Wed Dec 02, 2020 2:41 pmHi,
While I think all this stuff is excellent, people need to be careful as isn't scraping of data illegal ?
Cheers,
Its unlikely to be straight forward, e.g. the FBRef site pays a 3rd party for a lot of its data for use on its website so if you publish that data you could potentially have two entities after you - and does anyone really have the willpower to go through all the T&C's to really figure it out?
Suspect you are fine for personal use but not sure you are safe by publishing it on the betangel forum (why risk it?).
-
- Posts: 3219
- Joined: Thu Oct 24, 2019 8:25 am
- Location: Newport
Agreed.sionascaig wrote: ↑Thu Dec 03, 2020 9:56 amI think it depends on the websites Terms of Service (which you agree to by using their site) & specifically whether you publish it. Plenty of lawyers out there who will happily send you a cease & desist letter and damages request.paspuggie48 wrote: ↑Thu Dec 03, 2020 9:42 amAgreeVladimir CC wrote: ↑Wed Dec 02, 2020 5:51 pm
web scraping is like going manually by yourself on a website and noting down the info, except you have a bot that's doing it. nothing illegal IMO
Its unlikely to be straight forward, e.g. the FBRef site pays a 3rd party for a lot of its data for use on its website so if you publish that data you could potentially have two entities after you - and does anyone really have the willpower to go through all the T&C's to really figure it out?
Suspect you are fine for personal use but not sure you are safe by publishing it on the betangel forum (why risk it?).
But some of them are obviously a dead give away as to where the data has been scrapped from. To me that's just asking for trouble!
You do not have the required permissions to view the files attached to this post.
-
- Posts: 1074
- Joined: Fri Nov 20, 2015 9:38 am
Yes, and that example also has trademark / copyright issues re logo.
- paspuggie48
- Posts: 640
- Joined: Thu Jun 20, 2013 9:22 am
- Location: South-West
Ruddy hell...we are only trying to help.
I think these guys may be trying to help you also. It's a great thing what you & Memphis have done but they do have a point & them saying it "could be a life saver".
Some sites don't mind you scraping and sharing... I can't remember the site Memphis has made reference to but I once used it a while back for NBA data & they openly say that they dont mind and also ask you to share where you got the data, others aren't so scraper friendly though from what I've read up.
-
- Posts: 3219
- Joined: Thu Oct 24, 2019 8:25 am
- Location: Newport
Hi,
I wasn't trying to be negative and I said it was excellent stuff.
But broadcasting where the data is coming from is a giving them ammunition in any legal issues. TimeForm having an expensive API springs to mind. I doubt they will look kindly on anyone scraping their data and sharing for free.
Anyway, its all good stuff.
Cheers,
I wasn't trying to be negative and I said it was excellent stuff.
But broadcasting where the data is coming from is a giving them ammunition in any legal issues. TimeForm having an expensive API springs to mind. I doubt they will look kindly on anyone scraping their data and sharing for free.
Anyway, its all good stuff.
Cheers,
- paspuggie48
- Posts: 640
- Joined: Thu Jun 20, 2013 9:22 am
- Location: South-West
It's not a problem gents, it's not like Memphis or I are selling it or profiting from it and I know about Timeform and their £500/mth API charge. Pretty hefty and unjustified cost that is LOL.
Personally, you will have seen many of my solutions have no logo...easiest solution is not to have any
...watch this space !
Personally, you will have seen many of my solutions have no logo...easiest solution is not to have any
...watch this space !
Cant imagine you would have much if any of an issue anyway, pinging their website a few times a day (assuming none of the files need constant refreshes) with all different i.p address's that have downloaded the file isn't going to raise many eyebrows. Defo a good idea to scrap the logo though.