[FreeNAS 9 Plugins] - SAB / SB / CP / HP / Maraschino / HTPC / Mylar / LL / Gamez

[jasn]

@Joshua Parker Ruehlig

Thanks Josh.

I'll play around with it and see what the performance impact is when the tunnel is up. If it's not too bad, I could even set it up to so that all internet communications from the sabnzbd_1 jail is through the vpn. PIA is pretty fast.

Jason

 

[AirborneTrooper]

Sonarr doesn't play well with NzbToMedia so I had to use it's built in renamer. It's post processing though. I like it's interface better than SickRage, but I like how SickRage will let you manually post process if something doesn't work right. I'm also able to find some missing episodes for a few shows SickRage just couldn't find.

 

[jasn]

Hey Josh,

Since this is a new system, after following your blog and video tutorial to setup SAB/SR/CP correctly, I decided to trash it and see if I could do it all over again, (only quicker). I hit a snag though. This post, in this thread, describes receiving the following error message when trying to load the Sickrage webconsole;

Code:

Traceback (most recent call last):
File "/usr/pbi/sickrage-amd64/share/sickrage/SickRage/tornado/web.py", line 1313, in _execute
result = self.prepare()
File "/usr/pbi/sickrage-amd64/share/sickrage/SickRage/tornado/web.py", line 2002, in prepare
raise HTTPError(self._status_code)
HTTPError: HTTP 404: Not Found

Well I got it too. The only way I could get the Sickrage console back up was to reverse one of your instructions, changing;

Replace the relevant line in /var/db/sickrage/config.ini

Code:

web_root = /sickrage

back to the default;

Code:

web_root = ""

But when I did that, SAB/SR post-processing died, and my tv episodes stayed in the download hierarchy.

I remember you saying in your video tutorial that you had setup nginx so you could access all servers using the url, [server_address]:/[service_name], instead of the port number. Is this related to that configuration? Would the fix be to configure nginx the same way you have the server/service setup?

Jason

 

[Joshua Parker Ruehlig]

Hey Josh,

Since this is a new system, after following your blog and video tutorial to setup SAB/SR/CP correctly, I decided to trash it and see if I could do it all over again, (only quicker). I hit a snag though. This post, in this thread, describes receiving the following error message when trying to load the Sickrage webconsole;

Code:

Traceback (most recent call last):
File "/usr/pbi/sickrage-amd64/share/sickrage/SickRage/tornado/web.py", line 1313, in _execute
result = self.prepare()
File "/usr/pbi/sickrage-amd64/share/sickrage/SickRage/tornado/web.py", line 2002, in prepare
raise HTTPError(self._status_code)
HTTPError: HTTP 404: Not Found

Well I got it too. The only way I could get the Sickrage console back up was to reverse one of your instructions, changing;

back to the default;

Code:

web_root = ""

But when I did that, SAB/SR post-processing died, and my tv episodes stayed in the download hierarchy.

I remember you saying in your video tutorial that you had setup nginx so you could access all servers using the url, [server_address]:/[service_name], instead of the port number. Is this related to that configuration? Would the fix be to configure nginx the same way you have the server/service setup?

Jason

this is a know bug. all it is, is a missing redirect from / to /sickrage

just set the web_root how I have it and visit http://jail_ip/sickrage

if you have nginx set you shouldn't be using the links anymore. just use http://jail_IP/plugin

 

[jasn]

this is a know bug. all it is, is a missing redirect from / to /sickrage

just set the web_root how I have it and visit http://jail_ip/sickrage

if you have nginx set you shouldn't be using the links anymore. just use http://jail_IP/plugin

<facepalm>

Sorry Josh. I'm an idiot. I re-read the posts in this thread following the one I linked to, and see where you stated that you'd already reported this bug. I went back in and changed the web_root settings per your tutorial.

Anyway, all of the other consoles are accessible via jail_ip/plugin, except when I tried jail_ip/sickrage, it didn't work at first, (I got the nginx 502 bad gateway blank page error). I then tried jail_ip:8081/sickrage and it worked. I then went back and tried jail_ip/sickrage again, and now it works.

Oh well. It's working now.

Jason

 

[malum-in-se]

I still can't believe I've gotten everything up and running headless with flawless sorting. Thanks for your time Josh in making this a reality. I've been waiting for this solution for three years.

But as these projects are want to do; another question is borne: what do people so in terms of virus scanning? Before everything went to a windows 7 machine and was then copied to freenas manually. It got virus checked on the windows 7 machine that was doing the downloading.

For what its worth, I've got my old freenas board now running Ina 1u rack running pfsense as a firewall, so that could be part of the solution. Does anyone care to share how the handle virus scanning?

 

[Joshua Parker Ruehlig]

I still can't believe I've gotten everything up and running headless with flawless sorting. Thanks for your time Josh in making this a reality. I've been waiting for this solution for three years.

But as these projects are want to do; another question is borne: what do people so in terms of virus scanning? Before everything went to a windows 7 machine and was then copied to freenas manually. It got virus checked on the windows 7 machine that was doing the downloading.

For what its worth, I've got my old freenas board now running Ina 1u rack running pfsense as a firewall, so that could be part of the solution. Does anyone care to share how the handle virus scanning?

You're asking if sickrage/couchpotato may automatically downloads a virus? And that you may accidentaly execute it? There are posters on usenet that post WMV files that ask Windows to install a codec, the NZB also includes a codec.exe that users would be tricked into running. But..

• The way I configure nzbToMedia, anything but video files are deleted
• It also uses ffmpeg to check the video file is real and not "corrupt"
• I personally watch my videos either on my OpenELEC (linux+Kodi) Home Theater PC or through MediaBrowser (which is running in a jail).

The only vulnerability I could imagine would be a video file that gets past the ffmpeg check, but somehow exploits a yet unknown bug in whatever video player you are using. To me this doesn't sound like anything to lose sleep over. Just keep you video players patched (setup OpenELEC to autoupdate) and don't run Windows (99% issues gone right there).

I don't know how pfSense would make any difference in this situation. A virus is something that gets executed at the client, not something that needs to penetrate a network.

 

[jasn]

I've been successfully running SAB/TR/CP/SR using this howto/method. I then added Headphones to the jail, edited settings in /var/db/headphones/config.ini, nginx.conf, as well as autoProcessMedia.cfg , started it up and edited other settings using the GUI, and it appears to be running correctly.

I then installed Maraschino into the jail and started it up via the FreeNAS GUI. When I went to the [jail_ip_address]:7000 Maraschino GUI, I configured the modules for SAB/TR/CP and HP. However, using the SB module for my installation of SR, didn't work. My two questions are;

1) Does Sickrage have a separate module for Maraschino?
2) Are there any other settings, or configuration file edits needed, in order to configure Maraschino?

I did stop my nginx service, edit the nginx.conf file to add a webroot for maraschino, and then started it again, but I can only get to the Maraschino GUI using [jail_ip_address]:7000 and not [jail_ip_address]/maraschino.

Thanks,

Jason

 

[Joshua Parker Ruehlig]

I've been successfully running SAB/TR/CP/SR using this howto/method. I then added Headphones to the jail, edited settings in /var/db/headphones/config.ini, nginx.conf, as well as autoProcessMedia.cfg , started it up and edited other settings using the GUI, and it appears to be running correctly.

I then installed Maraschino into the jail and started it up via the FreeNAS GUI. When I went to the [jail_ip_address]:7000 Maraschino GUI, I configured the modules for SAB/TR/CP and HP. However, using the SB module for my installation of SR, didn't work. My two questions are;

1) Does Sickrage have a separate module for Maraschino?
2) Are there any other settings, or configuration file edits needed, in order to configure Maraschino?

I did stop my nginx service, edit the nginx.conf file to add a webroot for maraschino, and then started it again, but I can only get to the Maraschino GUI using [jail_ip_address]:7000 and not [jail_ip_address]/maraschino.

Thanks,

Jason

not sure about the module support in maraschino, I don't use them and basically just use maraschino for the links and disk usage widget + kodi is useful.

as for maraschino, you probably need to restart maraschino.

also I make maraschino the default page with this in my server block..

Code:

return 301 $scheme://$host/maraschino/;

 

[CraftyClown]

Hi Josh, me again :D

I was just wondering how you add an unrar package to Sick Rage? Is it through a shell command?

 

[Joshua Parker Ruehlig]

Hi Josh, me again :D

I was just wondering how you add an unrar package to Sick Rage? Is it through a shell command?

pkg install unrar

is that an optional dependency of sickrage now like couchpotato? I'll add it in then.

 

[CraftyClown]

Cheers Josh,

yes, there's an 'Unpack' option, under post processing

 

[CraftyClown]

Ok, so I'm still scratching my head a bit, trying to work out a way to get the best out of my config.

I have Couch Potato and Sick Rage installed and connected to my private torrent trackers. They are successfully downloading the torrents I'm after and then placing them in a folder which I have synced via BTSync to a paid seedbox account I have. The seedbox downloads my Movies/tv shows and send them back to me via another synced BTSync folder to my Freenas box. Now here's where the problems start though, as all my downloads are now in one folder which is synced back to my seedbox.

An example of this problem occured yesterday when I downloaded an entire season of a show in 1080p. The show was synced to my machine and then post processed by Sick rage. Sick rage unrared the file and copied it to my TV show folder, however the file that had been unrared was still in my sync folder and was then sent straight back to my seedbox along with all the other episodes, totalling 40gigs worth of data. if I try manually deleting those files, the next time sick rage does a scan, it unpacks them again and starts uploading

I'm desperately looking for a way to add a step into the process. Have an initial download folder that is synced with my seedbox, and have a plugin/script/ copy the files from that folder to another, upon which sick rage/ couch potato can do their post processing.

Am I right in thinking the NZBtomedia scripts would do something like this? I just don't know how I would implement them or something like them into my config, seeing as I'm purely working with torrents and my seedbox is offsite

Any ideas?

 

[Joshua Parker Ruehlig]

Ok, so I'm still scratching my head a bit, trying to work out a way to get the best out of my config.

I have Couch Potato and Sick Rage installed and connected to my private torrent trackers. They are successfully downloading the torrents I'm after and then placing them in a folder which I have synced via BTSync to a paid seedbox account I have. The seedbox downloads my Movies/tv shows and send them back to me via another synced BTSync folder to my Freenas box. Now here's where the problems start though, as all my downloads are now in one folder which is synced back to my seedbox.

An example of this problem occured yesterday when I downloaded an entire season of a show in 1080p. The show was synced to my machine and then post processed by Sick rage. Sick rage unrared the file and copied it to my TV show folder, however the file that had been unrared was still in my sync folder and was then sent straight back to my seedbox along with all the other episodes, totalling 40gigs worth of data. if I try manually deleting those files, the next time sick rage does a scan, it unpacks them again and starts uploading

I'm desperately looking for a way to add a step into the process. Have an initial download folder that is synced with my seedbox, and have a plugin/script/ copy the files from that folder to another, upon which sick rage/ couch potato can do their post processing.

Am I right in thinking the NZBtomedia scripts would do something like this? I just don't know how I would implement them or something like them into my config, seeing as I'm purely working with torrents and my seedbox is offsite

Any ideas?

Sorry, this setup is sorta confusing to me.

• What's the seedbox for?
• What's the reason for not downloading and processing files on freenas itself?

The main purpose of the nzbToMedia scripts are to do post-processing immediately after downloading (instead of having sickrage/couchpotato scanning a folder constantly). They also add a few features like the ability to check for a corrupted video file using ffmpeg.

 

[CraftyClown]

The seedbox is simply to prevent my internet connection being ravaged 24/7. It's also a hell of a lot faster than my home connection

Everything is seeded offsite and the final completed downloads arrive on my Freenas box once finished

I'm just looking for a solution to move the files before they are post processed

 

[Joshua Parker Ruehlig]

Seedbox (torrent downloading / uploading )
^
|
btsync
|
V
FreeNAS (download post-processing)

####

You have something like this?
Did you want to continue sharing downloads after being processed at your home?

 

[Joshua Parker Ruehlig]

Assuming you want to continue sharing downloads I guess the issue is sickrage unpacks archives in the same folder they orignally exist in. Which also is the folder you are syncing.

I think there is a way to make btsync readonly on one share, though I'm not an expert.
I don't think nzbToMedia could be triggered in this situation, it's usually triggered by the downloader.

 

[diskdiddler]

Well my jails are no more than 2 to 4gb a pop, there's only 5 of them (only about 5 plugins worth grabbing at this time IMO) so that's no more than 20gb or so to back it all up.
Unless you're saying, that in order to backup the jail, the backup process would end up trying to snatch the contents of the mountpoint?
So when the backup hits /mnt/ within the jail PBI thing, would also unfortunately grab /mnt/array/media/downloads/*.* ?
(If that's what you're implying, makes sense and could be awkward)

Thing is, all 5 of my jails are about 2 to 10 hours work to configure them right, one of them is full of pretty valuble data (couchpotato wanted list) I'd like a way to get all 5 jails and just ... back them up entirely. So if I built a brand new FreeNAS box on completely different hardware, I could just create 5 blank jails and import the 5 old ones which I've got backed up.
Is that possible?

probably is possible to completely save the jails, but I'd personally just install 5 new jails to the same IPs, then restore the datadirectories for the applications.

you wouldn't be redundantly backing up jail OS files. also no reconfiguring of CP/SAB would be necessary. and you wouldnt need to figure out how FN adds jails to its database.

that's just how I would do it.

Sorry to bump an old subthread:

Josh / others.
I am going to perform an update to 9.3 in the next 48 hours from 9.2.1.6.
Incase it goes terribly, what command can I do from the shell (either the jail shell or the main FreeNAS shell) which will rar / tar / zip the ENTIRE jail in full, entirely into a single compressed file, elsewhere on my NAS (which I can copy off later)
I want to comprehensively backup CouchPotato, Sickbeard and QBittorrent (custom jail, no plugin still, right?) those 3 are the most difficult ones to restore if lost.

SabNZBD, Crashplan I can manually reconfigure in around 30 minutes, no big deal.

 

[cyberjock]

You want a snapshot of the jail dataset.

And I'd recommend you upgrade to 9.2.1.9 before you go to 9.3.

 

[diskdiddler]

You want a snapshot of the jail dataset.

And I'd recommend you upgrade to 9.2.1.9 before you go to 9.3.

Hi CJ,

Thanks for that I wasn't aware 9.2.1.9 might be the way to go, there's a thread here on it .
https://forums.freenas.org/index.php?posts/161750/


As for the snapshot, I'm being super paranoid and assuming I'm going to lose the lot, so I'd kind of like to make an actual compressed file containing the contents, which I can just dump back in, over the top of a new jail eventually. I can do the snapshot too of course.

I assume TAR is the standard package for doing this.