Are you a coder or whitehat hacker looking to make some money on the side Bug bounty hunting might be the perfect gig for you. Welcome to Our Community. While Linux. org has been around for a while, we recently changed management and had to purge most of the content including users. Linux distributions for mining Bitcoin and other cryptocurrencies. For AMD and Nvidia GPU mining, use PiMP. For AMD GPU mining, use ethOS. Raspberry Pi How I built an Octa. Pi style computing cluster. The inspiration for this post and this project came from something that I recently read in the Raspberry Pi blog. I would like to start out by saying if you are interested in computers, programming, DIY electronics, space exploration, or just technology in general, you are very likely to find the Raspberry Pi blog interesting and entertaining. Octa. Pi Raspberry Pi Cluster. Image Raspberry Pi Foundation. The project I am starting here is based on Octa. Pi Cluster Computing and Cryptology. Its basically a way of connecting and configuring a number of Raspberry Pi systems into a cluster of servers with a single client to control them and dispatch jobs to them. Of course, the project as described in that blog post, and in the detailed Build an Octa. Pi instructions, is very professional looking, using nine identical Raspberry Pi 3 systems, each with an LED HAT blinking lights always make a project look better, and the whole thing is mounted on a colorful perspex board. What I hope to build will be made up of the various Raspberry Pi systems I have scattered about on my desk, ranging from the original Model B to the latest Zero W, and no two are the same. Also, the original project uses a 1. I will be using whatever power supplies I can find around here, so it will be a challenge to get them all plugged in and keep the cables reasonably neat and the circuit breakers in my house intact. Getting started. The first step in this project is simply getting together the necessary materials, and making sure the software is up to date. It is not necessary to create an Octa. Pi cluster with exactly eight Raspberry Pi servers. You can use pretty much as many as you like, although only one server couldnt really be called a cluster, and by the time you get to eight or so you are likely to be struggling to power them all. I am going to use the following, which is determined by one simple criterion its all that Ive got Model B Model BPi 2. Pi 3. Zero v. 1. 2. Zero v. 1. 3. Zero WMy motley crew. Some of these are already running Raspbian, so I will just have to make sure they are updated. Others are running Fedora, Pi. Core, Manjaro, Kali, or open. SUSE, so I have more work to do to prepare them. I will be using a TP Link WR8. N Nano router, because it is small, simple and inexpensive less than 3. CHF. I strongly very strongly recommend you do not use your home wi fi network for this project. While it might well work for you, it is likely to expose you to some serious security risks. The instructions for this project use open SSH connections with default user names and passwords, for example. Not a good idea at all. One of the more mundane aspects of this build is going to be powering all of the Pi systems. The original project mentions a very spiffy Universal 1. USB charging Hub, which is capable of delivering 2. A simultaneously to all ten ports. Zowie Thats a nice piece of kit for a project like this unfortunately, I cant find anything like it here in Switzerland. To be sure what capacity power supplies I will need, I checked the Raspberry Pi FAQs, where there is a very handy table listing the power requirements for each model. Now I just have to see if I can find some reasonable multi port power supply, or if I will have to cobble together a bunch of separate power supplies. Finally, each of the Raspberry Pis that I use will need a wireless network connection. The Pi 3 and Zero W have that built in, of course, but for the other five I will need USB Wi. Fi dongles. Im not sure that I have enough of those laying around, but if necessary I can get a very low priced 8. Pi Shop. ch. One small piece of advice on this when buying a USB wi fi dongle, make sure that it has already been tested with Raspbian. First step the client. The first Pi system I will set up is the one which will be used to manage the cluster the project description refers to this one as the Octa. Pi Client. It is the only system which will have a keyboard, mouse, and display in the final setup, and it will be used to monitor the cluster servers, dispatch and manage jobs to them, and to reboot or shut them down. The Client Raspberry Pi Model B. Image J. A. Watson. I am going to use my oldest Raspberry Pi Model B for this task, because there isnt much work to be done by this system. I want to keep the systems which have faster CPUs and more memory for use as servers in the cluster. This one is already running Raspbian, so I just have to make sure that it has all the latest updates installed. That requires an internet connection duh, then I just use this sudo sh c apt get update apt get dist upgrade apt get autoremoveBecause this is the oldestslowest of my Raspberry Pi systems, and I tend not to use it all that often, there were a lot of updates to be installed. Then those updates took a long time to download and install, so this was a time consuming process. Next I have to install the utilities and application software needed for this project. This is kind of interesting, because there are three different things to be installed, and they are downloaded and installed in three different ways. The cluster operation in this project is done using a small group of Python packages. These are installed using the Python pip. Note the double equals notation that is not a typo also, note the version specification, without it you will get a later version of the package, which does not yet work on Raspbian. Next, it needs the nmap utility, which will be used to find the cluster members it is installed using the apt get utility that we are already familiar with sudo apt get install nmap. Finally, I need the Octa. Pi software, which is available on the github development platform, so it is downloaded using the git clone command git clone https github. This actually gets both the client and server files. We only need the client side on this system, so I can move them to my home directory mv octapi setupclient homepi. Believe it or not, thats all the client needs at this time, So I can shut it down and set it aside, and turn my attention to the first of the cluster servers. Second step a cluster server. This is where I start to see the first consequences of my decision about which Raspberry Pi systems to use for cluster servers. In the project description they use eight identical Pi 3 systems. Besides the aesthetic appeal of that, there is a huge benefit in the fact that the setup procedure for every server is identical. So identical, in fact, that you actually only have to go through the setup and configuration once, then you can simply clone the SD card for each of the other servers. Nice. My systems have all sorts of different SD cards, and some of them are currently not even running Raspbian I have Pi. Core, Manjaro, Kali, Fedora and open. SUSE loaded on various of them. So I am going to have to check each one, update those which are already running Raspbian, and on those running something else I will have to either prepare a new SD card or overwrite their existing card either way, those will require a fresh installation. The First Server Raspberry Pi 3 Model B. Image J. A. Watson. I am going to use my Raspberry Pi 3 for the first cluster server system, mostly because the Pi 3 has built in wireless networking, so thats one less thing to have to fiddle with during this first setup. While preparing the first SD card, I remembered something I had written above the server systems will not have a monitor, keyboard, or mouse. That made me consider using Raspbian Jessie Lite rather than the full Jessie with PIXEL, because it is considerably smaller, so it is faster to download and copy to the SD card. There are a few other things to consider when deciding between Jessie Lite and Jessie with PIXEL, though. First, some of the operating system configuration that has to be made is a lot easier to do on the GUI than from the CLI things like wi fi connection, for example. Second, the PIXEL GUI is not the only thing that is not included in Jessie Lite python. In the end, even though I am a pretty dedicated and experienced CLI user, I would say that it is better or at least easier to install the full Raspbian with PIXEL on all of the Raspberry Pi systems used in this project.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. Archives
November 2017
Categories |