Posts

By Arpit Joshipura, General Manager, Networking and Orchestration, The Linux Foundation

We are excited to announce that SNAS.io, a project that provides network routing topologies for software-defined applications, is joining The Linux Foundation’s Networking and Orchestration umbrella. SNAS.io tackles the challenging problem of tracking and analyzing network routing topology data in real time for those who are using BGP as a control protocol, internet service providers, large enterprises, and enterprise data center networks using EVPN.

Topology network data collected stems from both layer 3 and layer 2 of the network, and includes IP information, quality of service requests, and physical and device specifics. The collection and analysis of this data in real time allows DevOps, NetOps, and network application developers who are designing and running networks, to work with topology data in big volumes efficiently and to better automate the management of their infrastructure.

Contributors to the project include Cisco, Internet Initiative of Japan (IIJ), Liberty Global, pmacct, RouteViews, and the University of California, San Diego.

Originally called OpenBMP, the project focused on providing a BGP monitoring protocol collector. Since it launched two years ago, it has expanded to include other software components to make real-time streaming of millions of routing objects a viable solution. The name change helps reflect the project’s growing scope.

The SNAS.io collector not only streams topology data, it also parses it, separating the networking protocol headers and then organizing the data based on these headers. Parsed data is then sent to the high-performance messagebus, Kafka, in a well-documented and customizable topic structure.

SNAS.io comes with an application that stores the data in a MySQL database. Others that use SNAS.io can access the data either at the messagebus layer using Kafka APIs or using the project’s RESTful database API service.

The SNAS.io Project is complementary to several Linux Foundation projects, including PNDA and FD.io, and is a part of the next phase of networking growth: the automation of networking infrastructure made possible through open source collaboration.

Industry Support for the SNAS.io Project and Its Use Cases

Cisco

SNAS.io addresses the network operational problem of real-time analytics of the routing topology and load on the network. Any NetDev or Operator working to understand the dynamics of the topology in any IP network can benefit from SNAS.io’s capability to access real-time routing topology and streaming analytics,” said David Ward, SVP, CTO of Engineering and Chief Architect, Cisco. “There is a lot of potential linking SNAS.io and other Linux Foundation projects such as PNDA, FD.io, Cloud Foundry, OPNFV, ODL and ONAP that we integrating to evolve open networking. We look forward to working with The Linux Foundation and the NetDev community to deploy and extend SNAS.io.”

Internet Initiative Japan (IIJ)

“If successful, the SNAS.io Project will provide a great tool for both operators and researchers,” said Randy Bush, Research Fellow, Internet Initiative Japan. “It is starting with usable visualization tools, which should accelerate adoption and make more of the Internet’s hidden data accessible.”

Liberty Global

“The SNAS.io Project’s technology provides our huge organization with an accurate network topology,” said Nikos Skalis, Network Automation Engineer, Liberty Global. “Together with its BGP forensics and analytics, it suited well to our toolchain.”

pmacct

“The BGP protocol is one of the very few protocols running on the Internet that has a standardized, clean and separate monitoring plane, BMP,” said Paolo Lucente, Founder and Author of the pmacct project. “The SNAS.io Project is key in providing the community a much needed full-stack solution for collecting, storing, distributing and visualizing BMP data, and more.”

RouteViews

“The SNAS.io Project greatly enhances the set of tools that are available for monitoring Internet routing,” said John Kemp, Network Engineer, RouteViews. “SNAS.io supports the use of the IETF BGP Monitoring Protocol on Internet routers. Using these tools, Internet Service Providers and university researchers can monitor routing updates in near real-time. This is a monitoring capability that is long overdue, and should see wide adoption throughout these communities.”

University of California, San Diego

“The Border Gateway Protocol (BGP) is the backbone of the Internet. A protocol for efficient and flexible monitoring of BGP sessions has been long awaited and finally standardized by the IETF last year as the BGP Monitoring Protocol (BMP). The SNAS.io Project makes it possible to leverage this new capability, already implemented in routers from many vendors,  by providing efficient and easy ways to collect BGP messages, monitor topology changes, track convergence times, etc,” said Alberto Dainotti, Research Scientist, Center for Applied Internet Data Analysis, University of California, San Diego “SNAS.io will not only have a large impact in network management and engineering, but by multiplying opportunities to observe BGP phenomena and collecting empirical data, it has already demonstrated its utility to science and education.”

You can learn more about the project and how you can get involved here https://www.SNAS.io.

The API Strategy & Practice Conference has become a Linux Foundation event and will be jointly produced with the Open API Initiative (OAI), a Linux Foundation project, The Linux Foundation announced today.

APIStrat2017, to be held Oct. 31 – Nov. 2 in Portland, OR,  will bring together everyone — from developers and IT teams, business users and executives to the API curious — to discuss opportunities and challenges in the API space. The event is now seeking speaking proposals from developers, industry thought leaders, and technical experts.

For the past seven years, APIStrat was organized by 3Scale, acquired by Red Hat in June 2016, which has donated the event to The Linux Foundation. This year, the eighth edition of the conference will once again provide a vendor-neutral space for discussion of the latest API topics.

“Like the Open API Initiative, (APIstrat) shares a commitment to a standard common format for API definitions, and see the transition for the event as a good fit,” said Steven Willmott, senior director and head of API Infrastructure, Red Hat.

In addition to APIStrat, The Linux Foundation hosts a variety of events that bring together the world’s leading technologists. These include Open Source Summit North America and Europe, MesosCon, ApacheCon, Apache Big Data, and many more.

“Linux Foundation events aim to bring together more than 20,000 members of the open source community this year alone,” said Linux Foundation Executive Director Jim Zemlin. “We’re pleased to team with OAI members and contributors to bring an already vibrant and well-regarded event to a broader open source community.”

Executive directors from top open source projects in cloud computing, blockchain, Internet of Things, and software-defined networking will keynote next month at Open Source Summit Japan, The Linux Foundation has announced. The full agenda, now available on the event website, also features a panel of Linux kernel developers and The Linux Foundation Executive Director Jim Zemlin.

LinuxCon, ContainerCon and CloudOpen have combined under one umbrella name in 2017 – Open Source Summit. More than 600 open source professionals, developers and operators will gather May 31-June 2  in Tokyo to collaborate, share information, and learn about the latest in open technologies, including Linux, containers, cloud computing and more.

Confirmed keynote speakers at this year’s event include:

  • Brian Behlendorf, Executive Director, Hyperledger

  • Philip DesAutels, Sr. Director of IoT, The Linux Foundation

  • Arpit Joshipura, General Manager, Networking, The Linux Foundation

  • Abby Kearns, Executive Director, Cloud Foundry Foundation

  • Jim Zemlin, Executive Director, The Linux Foundation

  • Linux Kernel Panel with Alice Ferrazzi, Gentoo Kernel Project Leader; Greg Kroah-Hartman, Linux Foundation Fellow; Steven Rostedt, Red Hat; and Dan Williams, Intel

Session highlights include:

  • TensorFlow in the Wild: From Cucumber Farmer to Global Insurance Firm – Kazunori Sato, Google

  • Fast releasing and Testing of Gentoo Kernel Packages and Future Plans of the Gentoo Kernel Project – Alice Ferrazzi, Gentoo Kernel Project Leader

  • Testing at Scale – Andrea Frittoli, IBM

  • Device-DAX: Towards Software Defined Memory – Dan Williams, Intel

  • Kubernetes Ground Up – Vishnu Kannan, Google

View the full agenda of sessions.

Linux.com readers get 5% off the “attendee” registration with code LINUXRD5. Register now and save $150 through April 16.

Automotive Linux Summit (ALS) is co-located with Open Source Summit Japan. Attendees may add on registration for ALS at no additional charge.                               

Applications for diversity and needs-based scholarships are also being accepted.

The following is adapted from Open Source Compliance in the Enterprise by Ibrahim Haddad, PhD.

Companies or organizations that don’t have a strong open source compliance program often suffer from errors and limitations in processes throughout the software development cycle that can lead to open source compliance failures.

The previous article in this series covered common intellectual property failures. This time, we’ll discuss the four common open source license compliance failures and how to avoid them.

License compliance problems are typically less damaging than intellectual property problems, as they don’t have the side effect of forcing you to release your proprietary source code under an open source license. But license compliance failures may still have serious consequences including:

  • An injunction preventing a company from shipping a product until source code is released.

  • Support or customer service headaches as a result of version mismatches (as a result of people calling or emailing the support hotline and inquiring about source code releases).

  • Embarrassment and/or bad publicity with customers and open source community.

4 Common OS License Compliance Failures

Problem #1: Failure to publish or make available source code packages as part of meeting license obligations

How to avoid it: Follow a detailed compliance checklist to ensure that all compliance action items have been completed when a given product, application, or software stack is released into the market.

Problem #2: Failure to provide correct version of the source code corresponding to the shipped binaries.

How to avoid it: Add a verification step into the compliance process to ensure that you’re publishing the version of source code that exactly corresponds to the distributed binary version.

Problem #3: Failure to release modifications that were introduced to the open source software being incorporated into the shipping product.

How to avoid it:

  • Use a bill of material (BOM) difference tool that allows the identification of software components that change across releases

  • Re-introduce the newer version of the software component in the compliance process

  • Add the “compute diffs” of any modified source code (eligible for open source distribution) to the checklist item before releasing open source used in the product.

Problem #4: Failure to mark open source code that has been changed or to include a description of the changes.

How to avoid it:

  • Add source code marking as checklist item before releasing source code to ensure you flag all the source code introduced to the original copy you downloaded

  • Conduct source code inspections before releasing the source code

  • Add a milestone in the compliance process to verify modified source code has been marked as such

  • Offer training to staff to ensure they update the change logs of source code files as part of the development process.

The most important outcome of non-compliance cases has been that the companies involved ultimately had to comply with the terms of the license(s) in question, and the costs of addressing the problem after the fact has categorically exceeded those of basic compliance.

Therefore, it is really a smart idea to ensure compliance before a product ships or a service launches. In part 6 of this series, we’ll cover some of the top lessons learned in achieving open source compliance that open source professionals need to know.

Download the free e-book, Open Source Compliance in the Enterprise, for a complete guide to creating compliance processes and policies for your organization.

Read the other articles in this series:

An Introduction to Open Source Compliance in the Enterprise

Open Compliance in the Enterprise: Why Have an Open Source Compliance Program?

Open Source Compliance in the Enterprise: Benefits and Risks

3 Common Open Source IP Compliance Failures and How to Avoid Them

4 Common Open Source License Compliance Failures and How to Avoid Them

Top Lessons For Open Source Pros From License Compliance Failures

Watch open source leaders, entrepreneurs, developers, and IT operations experts speak live next week, Oct. 4-6, 2016, at LinuxCon and ContainerCon Europe in Berlin. The Linux Foundation will provide live streaming video of all the event’s keynotes for those who can’t attend.

Sign up for the free streaming video.

The keynote speakers will focus on the technologies and trends having the biggest impact on open source development today, including containers, networking and IoT, as well as hardware, cloud applications, and the Linux kernel. See the full agenda of keynotes.

Tune into free live video streaming at 9 a.m. CET each day to watch keynotes with:

  • Jilayne Lovejoy, Principal Open Source Counsel, ARM

  • Solomon Hykes, Founder, CTO and Chief Product Officer, Docker

  • Brian Behlendorf, Executive Director, Hyperledger Project

  • Christopher Schlaeger, Director Kernel and Operating Systems, Amazon Development Center Germany

  • Dan Kohn, Executive Director, Cloud Native Computing Foundation

  • Brandon Philips, CTO, CoreOS

  • Many more

Can’t catch the live stream next week? Don’t worry—if you register now, we’ll send out the recordings of keynotes after the conference ends!

You can also follow along on Twitter with the hashtag #linuxcon. Share the live streaming of keynotes with your friends and colleagues!

The Linux kernel community came close this year to setting a new record for the number of changes merged in a single release, according to the latest Linux Kernel Development report released today by The Linux Foundation.

Kernel version 4.6 saw an astounding 13,517 patches merged in 63 days — just shy of the record set by version 3.15 at 13,722 patches on June 8, 2014.

But, changes to the kernel kept up their breakneck pace over the past 15 months, with more than 3 million lines of code added to the Linux kernel at a rate of 7.8 changes per hour.

“The ability to sustain this rate of change for years is unprecedented in any previous public software project,” according to the report.

The seventh edition of this report details the developers contributing to the kernel, the companies they work for, and the most significant changes made to the code and the development process since kernel version 3.18. The data mostly covers development since the last report was released in March 2015 — versions 3.19 to 4.7 — but some statistics go back to 2005 when development moved to the Git repository, and even back to Linus Torvalds’ first release in 1991.  

Celebrating the 25th Anniversary of Linux

This year the report also reflects on 25 years of Linux kernel development as the Linux and open source community gathers at LinuxCon North America in Toronto Wednesday night for a gala celebration commemorating the day Linus Torvalds first released Linux on Aug. 25, 1991.

At almost 22 million lines of code and a new release happening every 9-10 weeks, the Linux kernel is one of the largest, fastest moving open source projects in the history of technology. It’s also one of the most important as the core of the Linux operating system, which runs most of modern technology — from Android phones and Chromebooks, to nuclear submarines, the space station, global stock exchanges, and much more.

What started as Torvalds’ passion project has evolved over the past 25 years into a collective effort to build and maintain the code by thousands of developers employed by hundreds of companies.

“Clearly, the kernel developers are doing something right,” reads the report. “This report provides an update on what those developers have been doing and why they continue to be successful.”

Here are some of the highlights from the report, compiled from Git and analyzed by LWN Editor Jon Corbet and Linux kernel maintainer and Linux Foundation Fellow Greg Kroah-Hartman. Download the full report for more in-depth data and analysis.

2015-2016 Linux Kernel Development Highlights

From the report:

  • Almost 115,000 changesets have been merged since the 3.18 release on Dec. 7, 2014.

  • Contributions came from 5,062 individual developers representing nearly 500 corporations.  

  • 2,355 of those developers were first-time contributors

  • New features include support for live patching of the kernel, support for persistent-memory devices, encrypted storage for the ext4 filesystem, numerous networking enhancements with a focus on IPv6 and data-center improvements, and much more.

  • The “zero-day build and boot robot” testing system found nearly 400 bugs (all of which were fixed).

  • The busiest development cycle was kernel 4.6 with 13,517 patches merged — just shy of the record set by version 3.15 at 13,722 patches.

The top 10 developers contributing changes to the kernel were:

Name                         Number of changes
H Hartley Sweeten            1,456
Geert Uytterhoeven           1,036
Arnd Bergmann                  877
Al Viro                        782
Takashi Iwai                   735
Lars-Peter Clausen             729
Mauro Carvalho Chehab          714
Ville Syrjälä                  707
Linus Walleij                  661
Dan Carpenter                  631

The top 10 companies, which employ kernel developers to contribute to the Linux kernel, make up nearly 57 percent of the total changes to the kernel. The category “none,” which represents volunteer developers who aren’t paid by any company, fell to the No. 3 spot this year from No. 1 in the last report issued in 2015. And Renesas moved up in the rankings from No. 13, replacing Texas Instruments at No. 10.  A large portion of development continues to be developers of unknown corporate affiliation, who typically contribute 10 or fewer changes.

Company                Changes    Percent of total
Intel                  14,384     12.9%
Red Hat                 8,987      8.0%
None                    8,571      7.7%
Unknown                 7,582      6.8%
Linaro                  4,515      4.0%
Samsung                 4,338      3.9%
SUSE                    3,619      3.2%
IBM                     2,995      2.7%
Consultants             2,938      2.6%
Renesas Electronics     2,239      2.0%

 

Download the full report: “Linux Kernel Development: How Fast It is Going, Who is Doing It, What They Are Doing and Who is Sponsoring the Work”

Ahmed Alkabary is a recent graduate of the University of Regina in Canada, where he earned degrees in computer science and mathematics as an international student from Egypt. He was one of 14 aspiring IT professionals to receive a 2016 Linux Foundation Training (LiFT) scholarship, announced this week.   

ahmed_alkabary.png

Ahmed Alkabary

LiFT Scholarship winner Ahmed Alkabary

Ahmed began using Linux in the second year of his studies and quickly developed such a passion for it that he began extra studies outside of university to advance his skills. His enthusiasm for Linux even led him to develop a free course on Udemy to teach it to others; nearly 50,000 students have enrolled to date.

Now that he has finished his studies, Ahmed hopes to secure a job as a Linux system administrator. The scholarship will help him achieve his career goals by providing him with the additional training and certification he needs to land a position, he says.

Linux.com: Why do you want to be a Linux sysadmin?

Ahmed Alkabary: For me, I don’t just appreciate the Linux operating system but I also feel like it has become my life. Whenever I’m on a Linux based computer I feel like I’m at home. You can say it is a passion that has taken many years of cultivating to become integrated in my life the way it is today.

In 2011 I was eager to purchase a brand new computer, but to my dismay the shop had only one computer that met my requirements. Although unbeknownst to me the computer had a specific operating system that I was unfamiliar with. The operating system was pre-installed with Linux,  specifically openSuse. I was so hesitant to purchase the computer but proceeded anyway. I hoped to change the operating system once I got home, but I was unsure of what came over me to keep Linux. But to this day I feel I have yet to make a decision that would have a greater impact on my life then the day I decided to keep Linux.

Right away I started to notice the efficiency of Linux and how all my needs were met in an instant. I started to teach myself the command line and I became very proficient at it. Then I began to understand why it was developed and how it was created. This sparked a flame inside me to learn more and to research more. I was engulfed in Linux so that it started to become something that I just wanted to do for the rest of my life. This passion that I have for Linux gave me the idea to pursue a career as a Linux sysadmin.

Linux.com: What have you done so far to achieve that goal? How will the LiFT scholarship help?

Ahmed: I took many online Linux courses. I took Introduction to Linux on EdX made by The Linux Foundation. I also took Essentials of Linux System Administration on EdX. I also read many different books on Linux. I am preparing to take my LFCS certification exam next month and after that I would like to learn about the Linux kernel and how to contribute to the kernel project.

The LiFT scholarship will help cover the cost of the LFD420 Linux Kernel Internals and Development course. I want to be a Linux system administrator who has a full understanding of every aspect of Linux. Learning the Linux kernel would guarantee me that. I would also like to be a part of the open source community knowing very well about all the contributions they make to Linux. The kernel community is very supportive and knowledgeable and to become a part of that community would be an honor. In the long run, I even want to be able to write my own operating system!

Linux.com: How did you develop the Linux course on Udemy?

Ahmed: After a few years of using and learning about Linux, I began to notice that there are not so many online courses or resources presented in an approachable manner to newbies. People who want to migrate towards Linux but are afraid to make the move. That’s when it came to my mind to construct a course on Udemy explaining the basics of the Linux command line. I wanted to break the fear that newbies have towards Linux. Most users don’t understand the value and usefulness of the command line interface.

I wanted to explain everything in a simpler manner. I even added animations and graphics so users don’t get discouraged while learning. I decide to make the course completely free because Linux is free to begin with and it would go against my beliefs to charge for something that was free. My aim was never to deter people from Linux but to attract a massive audience all over the world to learn Linux and appreciate its versatility. I also realized that a majority of my students could not afford to pay for an online course.

Linux.com: What have you learned in teaching the course?

Ahmed: Making a course on Udemy and seeing all the messages that I get from the students thanking me for making the course and how I changed their lives motivates me on a daily basis. Whenever I feel like giving up and I get a positive review or a message from a student, It simply makes my day! One thing I learned also is that I am not a bad teacher after all!

Linux.com: You’re a recent graduate, what are you doing now?

Ahmed: Currently I am working as a part-time online instructor at Robertson College in Canada. I teach several computer science courses including introduction to Linux. I basically got this job because of my course on Udemy. Also I am preparing for my LFCS as I mentioned and also working on getting few other certifications (RHCSA , CCNA) to be able to get my dream job as a Linux system administrator. I have gotten numerous interviews for other jobs but I want to keep hunting for my dream to become a Linux sysadmin. I also believe that the LiFT scholarship would enormously help on achieving my dream on becoming a Linux sysadmin.

 

Interested in learning more about starting your IT career with Linux? Check out our free ebook “A Brief Guide To Starting Your IT Career In Linux.”

[Download Now]