Introduction 2 linux

Editor's Notes

• #2: 1
• #5: In computing, the kernel is a computer program that manages input/output requests from software and translates them into data processing instructions for the central processing unit and other electronic components of a computer. The kernel is a fundamental part of a modern computer's operating system.[1]
• #13: Quite often people new to another operating system than Microsoft Windows are confronted with the terms CLI (Command Line Interface) and GUI (Graphical User Interface). Pretty soon they get a notion about what those two are but at this stage they are still far away from being able to tell what is the "better" one. Well, there is no better -- it depends on the tasks that need be done, how experienced a user is and his personal likings.
• #14: This interaction between a computer operating system or application software and user is facilitated by the Shell. The shell includes both command-line and graphical elements for interacting with OS and apps. Graphical user interfaces (GUIs) are helpful for many tasks, but they are not good for all tasks.
• #16: There may be several Options, or none at all.
• #24: The easiest way to check from the Unix command line whether the internet connection works, is to send a request to a known server (e.g. www.google.com) using the ping <web address> command. The command reports, how long a message takes back and forth to the given server. It sends an ECHO_REQUEST datagram to elicit an ICMP ECHO_RESPONSE from a host or gateway.
• #25: Pipes - curl is more in the traditional unix-style, it sends more stuff to stdout, and reads more from stdin in a "everything is a pipe" manner. Curl vs wget: http://daniel.haxx.se/docs/curl-vs-wget.html Recursive! Wget's major strong side compared to curl is its ability to download recursively, or even just download everything that is referred to from a remote resource, be it a HTML page or a FTP directory listing.
• #26: Ssh encrypts all data that travels across its connection including your username and password (which you’ll use to login to the remote machine). When the node’s server arrives user’s will be able to login remotely to run jobs on the server. This is common for bioinformatics facilities, and enables users to use the existing (greater) resources such as storage, processing capacity of the server. Other commands such as sftp and scp allow users to securely copy a file to/ from remote hosts.
• #27: Some commands have additional arguments
• #29: To extract id lines from a fasta file, remove the id and # redirect the output to a id.txt file
• #31: Linux has inherited from UNIX the concept of ownerships and permissions for files. This is basically because it was conceived as a networked system where different people would be using a variety of programs, files, etc. Linux is also multi-tasking, meaning one user can use the same computer to do multiple jobs. UNIX everything is a file.
• #33: The Unix operating system (and likewise, Linux) differs from other computing environments in that it is not only a multitasking system but it is also a multi-user system as well. Each file has assigned 9 different permissions, 3 for the file user-owner (u), 3 for the group-owner (g) and 3 for everyone else (o). Ls -alshows something like this for each file/dir: drwxrwxrwx
• #34: The chmod (change mode) command protects files and directories from unauthorized users on the same system, by setting access permissions.
• #35: Does Linux need antivirus software? All computer systems can suffer from malware and viruses, including Linux. Thankfully, very few viruses exist for Linux, so users typically do not install antivirus software. It is still recommended that Linux users have antivirus software installed. Some users may argue that antivirus software uses up too much resources. Thankfully, low-footprint software exists for Linux.
• #36: Path contains directories separated by colons, and tells the shell where to look for programs. $PATH is a colon-separated list of directories in which the shell looks for commands.
• #37: Standard users, by default, cannot install applications on a Linux machine. In order to successfully install an application on a Linux machine you have to have super user privileges. So, to change a command so that you can successfully run an installation you have to prefix it with “sudo”, for example: sudo dpkg -i software.deb. To add a user to list of sudoers: # adduser foo sudo.
• #41: PHYLIP : Phylogeny Inference Package, computer programs for inferring phylogenies
• #44: A compiler is a computer program (or set of programs) that transforms source code written in a programming language (the source language) into another computer language (the target language, often having a binary form known as object code).[1] The most common reason for wanting to transform source code is to create an executable program. Check from program author’s website for detailed instructions on how to build program from source.
• #45: The standard output of command is connected via a pipe to the standard input of command2. This connection is performed before any redirections specified by the command (see REDIRECTION below). If |& is used, the standard error of command is connected to command2's standard input through the pipe; it is shorthand for 2>&1 |. This implicit redirection of the standard error is performed after any redirections specified by the command.
• #46: A pipeline is a sequence of one or more commands separated by one of the control operators: | or |&.
• #47: A shell program, called a script, is an easy-to-use tool for building applications by "gluing together" system calls, tools, utilities, and compiled binaries. scripts, programs written for a special run-time environment that can interpret (rather than compile) and automate the execution of tasks which could alternatively be executed one-by-one by a human operator. More than just the insulating layer between the operating system kernel and the user, it's also a fairly powerful programming language. Bash has become a de facto standard for shell scripting on most flavors of UNIX. Bourne shell compliant scripts are created with a .sh extension.
• #48: A variable is nothing more than a label, a name assigned to a location or set of locations in computer memory holding an item of data. PATH – Your shell search path: directories separated by colons HOME – Your home directory, such as /home/Smith
• #49: BASH variable is the full path name used to invoke the current instance of BASH
• #50: You can use env or printenv <variable_name> to print shell variable.The scope of a variable (i.e., which programs know about it) is by default, the shell in which it is defined. To make a variable and its value available to other programs your shell invokes (i.e., subshells), use the export command. This variable then becomes an environment variable since it’s available to other programs in your shell’s “environment”. The configuration of your bash shell is found in the hidden file .bashrc Usually the SYNTAX for setting an environment variable in your .bashrc (which is found in your home directory) is the following: export VARIABLE=value 1.2 NOTE: There shouldn't be any space between the variable and the equals sign ("=") and the value. If your value has spaces then the whole value should be put in quotes For the case of the environement variable PATH it is a good practice to prepend additional paths to it using colons ":" since it is a system defined environment variable. For example: export PATH=$HOME/bin/perl:$PATH 1.3 NOTE: That environment variables are accessed by prepending the dollar sign ("$"), but when defined the dollar sign is ommitted PATH is a variable that contains the directories from which your shell (BASH) looks for commands. These directories are separated by colons.
• #52: Pattern matching and data extraction of Linux command line tools like grep, sort, cut, etc. Enable handling of large text files which would otherwise consume large chunks of memory on other platforms such as Windows (or Linux) GUI for example.
• #53: The BLAST programs are widely used tools for searching DNA and protein databases for sequence similarity to identify homologs to a query sequence. The BLAST command line interface offers additional features such as querying a custom database eg. Chromosome of your organism of interest. More advanced usage generally involves taking the output of BLAST as a first step in some kind of script. For example, Torsten's "prokka" tool uses BLAST (amongst other things) to automatically annotate a sequence. Which can best be achieved from the command-line.
• #55: A number of cutting edge programs (Bowtie, Velvet, Trinity, Stampy, etc.) do not come with an web interface, because the developers neither have time nor computing resources to provide web services for everyone. As a rule of thumb, easier an website is to use, more difficult it is to develop. Furthermore, it costs a lot of money to maintain data-intensive web services.
• #56: Freedoms of the OS fosters/ encourages the development of more software to add to the already large existing ,command line, bioinformatics tools. Therefore, it will become common for primarily, wet lab, biomedical researchers to have some command-line knowledge and skill. While learning to use these tools may be challenging, at first, the rewards of UNIX/ Linux command-line proficiency is worth the effort. Therefore, in the tutorial to follow later today we are going to guide you through using some commands and we hope that you have fun doing it.