# Skately

**URL:** https://ukskateforum.co.uk/t/skately/1195
**Category:** General
**Created:** [June 19, 2020, 12:17pm UTC](https://ukskateforum.co.uk/t/skately/1195 "2020-06-19T12:17:40Z")
**Posts on this page:** 20
**Page:** 2

<div class="post-metadata">

### Author: ![Londonskater](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/londonskater/32/17195_2.png) [@Londonskater](https://ukskateforum.co.uk/u/Londonskater)
#### Post date: [June 19, 2020, 9:12pm UTC](https://ukskateforum.co.uk/t/skately/1195/22 "2020-06-19T21:12:04Z")

</div>

fuck, I would love a scraper so I can use it with Kodi.

@Mark Lets do this. You host and code. I’ll offer advice.

Deal?

---

<div class="post-metadata">

### Author: ![ForwardMotion](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/forwardmotion/32/34735_2.png) [@ForwardMotion](https://ukskateforum.co.uk/u/ForwardMotion)
#### Post date: [June 19, 2020, 11:25pm UTC](https://ukskateforum.co.uk/t/skately/1195/23 "2020-06-19T23:25:44Z")

</div>

Use to get into hole looking at old ads and shoes

---

<div class="post-metadata">

### Author: ![ciaran](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/ciaran/32/42_2.png) [@ciaran](https://ukskateforum.co.uk/u/ciaran)
#### Post date: [June 20, 2020, 12:07am UTC](https://ukskateforum.co.uk/t/skately/1195/24 "2020-06-20T00:07:53Z")

</div>

> [@Londonskater](#):
>
> fuck, I would love a scraper so I can use it with Kodi.
> 
> @Spanky Lets do this. You host and code. I’ll offer advice.
> 
> Deal?

was going to say something about the Plex thread on Slap, but you’ve already posted in that. Make it work with Plex!

---

<div class="post-metadata">

### Author: ![Londonskater](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/londonskater/32/17195_2.png) [@Londonskater](https://ukskateforum.co.uk/u/Londonskater)
#### Post date: [June 21, 2020, 6:06am UTC](https://ukskateforum.co.uk/t/skately/1195/25 "2020-06-21T06:06:24Z")

</div>

Another way to do this is to take an already existing scraper source and add skate videos to it…

for example, this site seems to have a few bits already and Kodi, Plex, etc. all can scrape from it.

> **[volcom — The Movie Database (TMDB)](https://www.themoviedb.org/search?query=volcom)**
>
> The Movie Database (TMDB) is a popular, user editable database for movies and TV shows.

> **[nike sb — The Movie Database (TMDB)](https://www.themoviedb.org/search?query=nike%20sb&language=en-US)**
>
> The Movie Database (TMDB) is a popular, user editable database for movies and TV shows.

---

<div class="post-metadata">

### Author: ![Mark](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/mark/32/11_2.png) [@Mark](https://ukskateforum.co.uk/u/Mark)
#### Post date: [June 21, 2020, 6:14am UTC](https://ukskateforum.co.uk/t/skately/1195/26 "2020-06-21T06:14:52Z")

</div>

Adding to an already existing source makes more sense

---

<div class="post-metadata">

### Author: ![Londonskater](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/londonskater/32/17195_2.png) [@Londonskater](https://ukskateforum.co.uk/u/Londonskater)
#### Post date: [June 21, 2020, 7:06am UTC](https://ukskateforum.co.uk/t/skately/1195/27 "2020-06-21T07:06:49Z")

</div>

Just testing it out…

The scraper struggles to find most as brand name isn’t included in regular film sites…  
So, you don’t have Transworld - Feedback. It’s just Feedback. It managed to automatically find less than 10% of what I tried to get it to search for.

So, you have to do it manually which defeats the idea.

Also, the naming convention once it does find the video is random as fuck.

 ![Screen Shot 2020-06-21 at 07.59.53](https://uksf-media.lon1.cdn.digitaloceanspaces.com/original/2X/f/fbd4cbb4931f3dddedbc6904b148df4782120580.png)

The point of a new scraper is that the biggest part (the data for all skate videos made) is taken care of.  
It’s great that there are existing scrapers for movies and you could use them to add skate videos to but realistically, no great user base is going to input 40 years of skate videos when the job is already done at [skatevideosite.com](http://skatevideosite.com).

---

<div class="post-metadata">

### Author: ![Londonskater](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/londonskater/32/17195_2.png) [@Londonskater](https://ukskateforum.co.uk/u/Londonskater)
#### Post date: [June 21, 2020, 7:37am UTC](https://ukskateforum.co.uk/t/skately/1195/28 "2020-06-21T07:37:35Z")

</div>

In fact, aside from Nike, Volcom and TWS it seems like there is next to nothing on there anyway - so even if it did automatically scrape, it is pointless with the current data set.

---

<div class="post-metadata">

### Author: ![Mark](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/mark/32/11_2.png) [@Mark](https://ukskateforum.co.uk/u/Mark)
#### Post date: [June 21, 2020, 8:03am UTC](https://ukskateforum.co.uk/t/skately/1195/29 "2020-06-21T08:03:33Z")

</div>

Looks like there are some options then

Somehow getting data from skatevideosite and import into new one or import into the [moviedb.org](http://moviedb.org) one

Easiest would be to have skatevideosite as scraping service as data and infrastructure already there?

---

<div class="post-metadata">

### Author: ![Londonskater](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/londonskater/32/17195_2.png) [@Londonskater](https://ukskateforum.co.uk/u/Londonskater)
#### Post date: [June 21, 2020, 8:28am UTC](https://ukskateforum.co.uk/t/skately/1195/30 "2020-06-21T08:28:24Z")

</div>

Yeah. Exactly. The only thing which needs to be built is the scraper as the database itself is already there.

> **[Building a Web Scraper from start to finish | HackerNoon](https://hackernoon.com/building-a-web-scraper-from-start-to-finish-bb6b95388184)**
>
> A Web Scraper is a program that quite literally scrapes or gathers data off of websites. Take the below hypothetical example, where we might build a web scraper that would go to twitter, and gather the content of tweets.

---

<div class="post-metadata">

### Author: ![Mark](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/mark/32/11_2.png) [@Mark](https://ukskateforum.co.uk/u/Mark)
#### Post date: [June 21, 2020, 8:31am UTC](https://ukskateforum.co.uk/t/skately/1195/31 "2020-06-21T08:31:52Z")

</div>

Skatevideosite is built on WordPress, am sure there’s some kind of scraping server plugin available. Have you tried adding it as a source anyway, they must’ve been asked about this before?

---

<div class="post-metadata">

### Author: ![Londonskater](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/londonskater/32/17195_2.png) [@Londonskater](https://ukskateforum.co.uk/u/Londonskater)
#### Post date: [June 21, 2020, 8:35am UTC](https://ukskateforum.co.uk/t/skately/1195/32 "2020-06-21T08:35:44Z")

</div>

You can’t just add a website as a source.

The reason you need a scraper is you need to convert their data from their layout into a database format - which media servers understand.

Check that link I posted.

---

<div class="post-metadata">

### Author: ![Londonskater](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/londonskater/32/17195_2.png) [@Londonskater](https://ukskateforum.co.uk/u/Londonskater)
#### Post date: [June 21, 2020, 8:39am UTC](https://ukskateforum.co.uk/t/skately/1195/33 "2020-06-21T08:39:55Z")

</div>

> [@Mark](#):
>
> Skatevideosite is built on WordPress, am sure there’s some kind of scraping server plugin available.

Also, I think what you are talking about here is a general definition of the term scraping whereas what is needed is quite specific and “scraping” is only the first step.

1. Scrape data from Skatevideosite (They seem to conform to a standard format)
2. Pull data into a structured info (.nfo) and image (.tbn) format
3. Output a .json format readable by Plex, Kodi and other media servers (Thankfully they all seem to work on roughly the same standard).

…at least, I think that is it.

---

<div class="post-metadata">

### Author: ![Mark](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/mark/32/11_2.png) [@Mark](https://ukskateforum.co.uk/u/Mark)
#### Post date: [June 21, 2020, 8:40am UTC](https://ukskateforum.co.uk/t/skately/1195/34 "2020-06-21T08:40:52Z")

</div>

No no what I mean is they may have already implemented the data feed, just not advertised it

---

<div class="post-metadata">

### Author: ![Mark](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/mark/32/11_2.png) [@Mark](https://ukskateforum.co.uk/u/Mark)
#### Post date: [June 21, 2020, 8:42am UTC](https://ukskateforum.co.uk/t/skately/1195/35 "2020-06-21T08:42:20Z")

</div>

Another alternative is to have other site that scrapes svsite and that serves the data instead. Which they may or may not be cool with if they can make revenue from it

---

<div class="post-metadata">

### Author: ![Londonskater](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/londonskater/32/17195_2.png) [@Londonskater](https://ukskateforum.co.uk/u/Londonskater)
#### Post date: [June 21, 2020, 8:42am UTC](https://ukskateforum.co.uk/t/skately/1195/36 "2020-06-21T08:42:37Z")

</div>

From my knowledge, that side is just a wordpress skate video fan site…

Is there a way to find out if they have that data feed?

---

<div class="post-metadata">

### Author: ![Londonskater](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/londonskater/32/17195_2.png) [@Londonskater](https://ukskateforum.co.uk/u/Londonskater)
#### Post date: [June 21, 2020, 8:43am UTC](https://ukskateforum.co.uk/t/skately/1195/37 "2020-06-21T08:43:35Z")

</div>

ha ha. guessing you haven’t read that link, then?

That is _exactly_ what we are getting at.

however, the website doesn’t need to be public or visible or pretty…its just a data feed

---

<div class="post-metadata">

### Author: ![Mark](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/mark/32/11_2.png) [@Mark](https://ukskateforum.co.uk/u/Mark)
#### Post date: [June 21, 2020, 8:44am UTC](https://ukskateforum.co.uk/t/skately/1195/38 "2020-06-21T08:44:05Z")

</div>

Definitely did not (thoroughly) read that link, just skimmed it 😬

---

<div class="post-metadata">

### Author: ![Mark](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/mark/32/11_2.png) [@Mark](https://ukskateforum.co.uk/u/Mark)
#### Post date: [June 21, 2020, 8:46am UTC](https://ukskateforum.co.uk/t/skately/1195/39 "2020-06-21T08:46:57Z")

</div>

I think ask skatevideosite admins if they have a feed existing already or if they mind being scraped. Then go from there.

If you get a positive response and it seems simple I might look into setting up scraper but I’m not promising anything!

---

<div class="post-metadata">

### Author: ![Londonskater](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/londonskater/32/17195_2.png) [@Londonskater](https://ukskateforum.co.uk/u/Londonskater)
#### Post date: [June 21, 2020, 8:49am UTC](https://ukskateforum.co.uk/t/skately/1195/40 "2020-06-21T08:49:29Z")

</div>

I think the shortest way to explain is that all these media servers need to know where to find info on the films and TV shows people have in their media folder.

People have built “scrapers” to find that info - and media servers like Kodi or Plex have a couple of those built in as that is a basic need of the users.

Those media server programs have options to add new “scrapers”, too. There are popular ones for Anime for example, as the standard data sources (IMDB for example) suck at cataloguing those films.

No one has built a scraper to point to a reliable info source for skate videos. This is the dream…

---

<div class="post-metadata">

### Author: ![Londonskater](https://ukskateforum.co.uk/user_avatar/ukskateforum.co.uk/londonskater/32/17195_2.png) [@Londonskater](https://ukskateforum.co.uk/u/Londonskater)
#### Post date: [June 21, 2020, 8:50am UTC](https://ukskateforum.co.uk/t/skately/1195/41 "2020-06-21T08:50:54Z")

</div>

It’s probably not worth asking permission as the lookup numbers are going to be so small…

also, better to ask forgiveness. 🙂

[Previous page](https://ukskateforum.co.uk/t/skately/1195.md?page=1)

[Next page](https://ukskateforum.co.uk/t/skately/1195.md?page=3)
