sunnuntai 11. toukokuuta 2014

Distributed ffmpeg


I'm in a process of giving form to a very old dream of mine - to create an efficient and cheap video encoding platform.


And following the great examples such as SETI@home, BitTorrent and BitCoin, it's gotta be a distributed one :)


If anyone has some thoughts on my current concept, I would be glad to receive them.


This is my toolset I chose for the task:



  • Vagrant for the virtual box that will contain the whole thing

  • ffmpeg for video conversions

  • Transmission BitTorrent client to transfer splitted video files (partials) for distributed conversion

  • bittorrent-dht for getting peers and their IP addresses in file transfers and to determine full nodes to connect to (with open ports) in order to join the actual distributed network

  • Hazelcast in-memory data grid to manage messaging between nodes

  • RHash to calculate and verify Magnet links

  • PeerGuardian for general protection from government spies and manual blacklisting of malicious nodes

  • Apache and PHP to create front-end interface used to actually manage the workflow


A flowchart of how this all could work can be found here (careful, it's a bit scary :P): http://bit.ly/1sgbdb6


The actual project repo is here: http://bit.ly/1g9XRxl


Wish me luck and again, thanks for any comments, questions etc. :)



submitted by martinambrus to linux

[link] [12 comments]

Ei kommentteja:

Lähetä kommentti

Huomaa: vain tämän blogin jäsen voi lisätä kommentin.