Debsources. Dive into Debian source code! Matthieu Caneill. April 11, 2015 MiniDebconf (Lyon, France) Debian contributor, PhD student at LIG
|
|
|
- Earl Robbins
- 6 years ago
- Views:
Transcription
1 Debsources Dive into Debian source code! Matthieu Caneill Debian contributor, PhD student at LIG April 11, 2015 MiniDebconf (Lyon, France)
2 Acknowledgements Debsources Initially developped at IRILL, by Stefano Zacchiroli and myself. Many persons have contributed patches since then. Matthieu Caneill Debsources MiniDebconf, April / 48
3 Acknowledgements Debsources Initially developped at IRILL, by Stefano Zacchiroli and myself. Many persons have contributed patches since then. Infrastructure Debsources servers are sponsored by IRILL. Matthieu Caneill Debsources MiniDebconf, April / 48
4 Acknowledgements Debsources Initially developped at IRILL, by Stefano Zacchiroli and myself. Many persons have contributed patches since then. Infrastructure Debsources servers are sponsored by IRILL. Slides Inspired by Stefano Zacchiroli s previous presentations. Licensed CC-BY-SA. Matthieu Caneill Debsources MiniDebconf, April / 48
5 Table of contents 1 Introduction 2 Features Debsources features What s new? Roadmap 3 Technologies 4 Research platform 5 Hacking Matthieu Caneill Debsources MiniDebconf, April / 48
6 Table of contents 1 Introduction 2 Features Debsources features What s new? Roadmap 3 Technologies 4 Research platform 5 Hacking Matthieu Caneill Debsources MiniDebconf, April / 48
7 What is Debsources? A web application to browse the source code of Debian packages The infrastructure behind: database, plugins,... Matthieu Caneill Debsources MiniDebconf, April / 48
8 What is Debsources? A web application to browse the source code of Debian packages The infrastructure behind: database, plugins,... Play with it! Navigate to Matthieu Caneill Debsources MiniDebconf, April / 48
9 Home page Matthieu Caneill Debsources MiniDebconf, April / 48
10 Source code display Matthieu Caneill Debsources MiniDebconf, April / 48
11 So what? Is this really useful? I want to check the source code of cowsay. What do? The old way cd /tmp apt-get source cowsay cd cowsay-3.03+dfsg1... cd.. rm -r cowsay-3.03+dfsg1 Note that it only works with Debian-based systems, and not with your iphone TM. Matthieu Caneill Debsources MiniDebconf, April / 48
12 So what? Is this really useful? I want to check the source code of cowsay. What do? The old way cd /tmp apt-get source cowsay cd cowsay-3.03+dfsg1... cd.. rm -r cowsay-3.03+dfsg1 Note that it only works with Debian-based systems, and not with your iphone TM. The new way lynx Almost runs on your typewriter. Matthieu Caneill Debsources MiniDebconf, April / 48
13 Table of contents 1 Introduction 2 Features Debsources features What s new? Roadmap 3 Technologies 4 Research platform 5 Hacking Matthieu Caneill Debsources MiniDebconf, April / 48
14 Source code browsing Syntax highlighting For all languages supported by highlight.js: C, C++, Java, Python, Ruby, Makefile... and 112 others. Matthieu Caneill Debsources MiniDebconf, April / 48
15 Source code browsing Syntax highlighting For all languages supported by highlight.js: C, C++, Java, Python, Ruby, Makefile... and 112 others. Included versions Packages in hamm, sink, potato, woody, sarge, etch, lenny, squeeze, wheezy, jessie (testing), unstable, experimental, oldstable-updates, stable-updates, proposed-updates, testing-proposed-updates, wheezy-backports, squeeze-lts are in Debsources. Matthieu Caneill Debsources MiniDebconf, April / 48
16 Searching You can search for: Packages Files File content ctags regular expressions through codesearch.debian.net Matthieu Caneill Debsources MiniDebconf, April / 48
17 Searching You can search for: Packages Files File content ctags regular expressions through codesearch.debian.net Content indexing Searching is fast, thanks to PostgreSQL s indexes. Matthieu Caneill Debsources MiniDebconf, April / 48
18 Advanced search Matthieu Caneill Debsources MiniDebconf, April / 48
19 Annotations and highlighting Suppose... I m a developer: I want to share a precise location in the source code of package X. I m a user: I can t compile software X, it fails at line 42 in the file Y. I m a static source code analyzer: I found a semantic error in file Y. Matthieu Caneill Debsources MiniDebconf, April / 48
20 Annotations and highlighting package/version/path/to/file.c?hl=a:b&msg=a:b:c#lxx Matthieu Caneill Debsources MiniDebconf, April / 48
21 Annotations and highlighting package/version/path/to/file.c?hl=a:b&msg=a:b:c#lxx package: cowsay version: path: cowsay highlight: 32:36 message: 30:Debian:rocks Matthieu Caneill Debsources MiniDebconf, April / 48
22 Annotations and highlighting package/version/path/to/file.c?hl=a:b&msg=a:b:c#lxx package: cowsay version: path: cowsay highlight: 32:36 message: 30:Debian:rocks Matthieu Caneill Debsources MiniDebconf, April / 48
23 Annotations and highlighting Developer: I want to share a precise location in the source code of package X. Matthieu Caneill Debsources MiniDebconf, April / 48
24 Annotations and highlighting User: I can t compile software X, it fails at line 42 in the file Y. Matthieu Caneill Debsources MiniDebconf, April / 48
25 Annotations and highlighting Static analyzer: I found a semantic error in file Y. Matthieu Caneill Debsources MiniDebconf, April / 48
26 Duplicated files All the files are in the database, along with their checksum. The duplicates can be computed, for every file. Matthieu Caneill Debsources MiniDebconf, April / 48
27 Duplicated files Matthieu Caneill Debsources MiniDebconf, April / 48
28 Integration in the ecosystem Codesearch is used for regular expression searches, and redirects its results back to Debsources. Credits: Michael Stapelberg Matthieu Caneill Debsources MiniDebconf, April / 48
29 Integration in the ecosystem Codesearch is used for regular expression searches, and redirects its results back to Debsources. Credits: Michael Stapelberg Package tracking systems The old ( and new ( PTS provide links to Debsources ( browse source code ). Credits: Paul Wise Matthieu Caneill Debsources MiniDebconf, April / 48
30 Integration in the ecosystem Codesearch is used for regular expression searches, and redirects its results back to Debsources. Credits: Michael Stapelberg Package tracking systems The old ( and new ( PTS provide links to Debsources ( browse source code ). Credits: Paul Wise Need to embed code somewhere? <iframe>s embedding of files content is supported (see documentation). Matthieu Caneill Debsources MiniDebconf, April / 48
31 Statistics Code source metrics for every package. Plugins: size, ctags, sloccount Matthieu Caneill Debsources MiniDebconf, April / 48
32 Statistics Code source metrics for every package. Plugins: size, ctags, sloccount Matthieu Caneill Debsources MiniDebconf, April / 48
33 Statistics Aggregated statistics are available at Metrics Disk usage SLOC (source lines of code) Number of source packages Number of files Number of ctags (symbols) Matthieu Caneill Debsources MiniDebconf, April / 48
34 Statistics Currently in the unstable suite: Disk usage 210 GB SLOC (source lines of code) 1,002,329,283 Number of source packages 22,763 Number of files 10,565,532 Number of ctags (symbols) 114,732,392 Matthieu Caneill Debsources MiniDebconf, April / 48
35 Statistics Fancy graphs Matthieu Caneill Debsources MiniDebconf, April / 48
36 API Along the graphical web interface, an API provides the same functionalities. Matthieu Caneill Debsources MiniDebconf, April / 48
37 API Along the graphical web interface, an API provides the same functionalities. Examples curl { status : ok, http status code : 200, last update : Fri, 10 Apr :16: } curl { pkg infos : { suites : [ woody... Documentation at Matthieu Caneill Debsources MiniDebconf, April / 48
38 What s new? Many new features since DebConf14 Matthieu Caneill Debsources MiniDebconf, April / 48
39 What s new? Many new features since DebConf14 OPW student: Jingjie Jiang (sophiejjj) Matthieu Caneill Debsources MiniDebconf, April / 48
40 What s new? Many new features since DebConf14 OPW student: Jingjie Jiang (sophiejjj) Many new contributors: Stefano Zacchiroli: 688 Matthieu Caneill: 455 sophiejjj: 58 Orestis Ioannou: 10 Jason Pleau: 10 Akshita Jha: 7 Clément Schreiner: 6 Jingjie Jiang: 5 Luciano Bello: 1 Paul Wise: 1 tessy joseph: 1 Christophe Siraut: 1 sodamatt: 1 Tapasweni Pathak: 1 Matthieu Caneill Debsources MiniDebconf, April / 48
41 What s new? Multiple pop-up messages Credits: Orestis Ioannou and Jason Pleau. Matthieu Caneill Debsources MiniDebconf, April / 48
42 What s new? Blueprints support Credits: Jingjie Jiang Blueprints Flask apps embedded and plugged together Implied a big refactoring New features incoming Matthieu Caneill Debsources MiniDebconf, April / 48
43 What s new? Detailed directory listing Credits: Jingjie Jiang Matthieu Caneill Debsources MiniDebconf, April / 48
44 What s new? File edition in-browser Credits: Raphael Geissert File edition A plugin for Iceweasel and Chromium enables the edition of files in your browser. A patch ready-to-be-sent TM is generated! Matthieu Caneill Debsources MiniDebconf, April / 48
45 What s new? And many many other features... Refactoring Matthieu Caneill Debsources MiniDebconf, April / 48
46 What s new? And many many other features... Refactoring Debsources as a top-level Python module Matthieu Caneill Debsources MiniDebconf, April / 48
47 What s new? And many many other features... Refactoring Debsources as a top-level Python module Configuration loader Matthieu Caneill Debsources MiniDebconf, April / 48
48 What s new? And many many other features... Refactoring Debsources as a top-level Python module Configuration loader Flake8 compliance (Zack, Jingjie Jiang, and others) Matthieu Caneill Debsources MiniDebconf, April / 48
49 What s new? And many many other features... Refactoring Debsources as a top-level Python module Configuration loader Flake8 compliance (Zack, Jingjie Jiang, and others) Test coverage (Jingjie Jiang, Clément Schreiner, and others) Matthieu Caneill Debsources MiniDebconf, April / 48
50 What s new? And many many other features... Refactoring Debsources as a top-level Python module Configuration loader Flake8 compliance (Zack, Jingjie Jiang, and others) Test coverage (Jingjie Jiang, Clément Schreiner, and others) Case-insensitive package name search (Akshita Jha) Matthieu Caneill Debsources MiniDebconf, April / 48
51 What s new? And many many other features... Refactoring Debsources as a top-level Python module Configuration loader Flake8 compliance (Zack, Jingjie Jiang, and others) Test coverage (Jingjie Jiang, Clément Schreiner, and others) Case-insensitive package name search (Akshita Jha)?lang=LANG to override detected language (Jingjie Jiang) Matthieu Caneill Debsources MiniDebconf, April / 48
52 What s new? And many many other features... Refactoring Debsources as a top-level Python module Configuration loader Flake8 compliance (Zack, Jingjie Jiang, and others) Test coverage (Jingjie Jiang, Clément Schreiner, and others) Case-insensitive package name search (Akshita Jha)?lang=LANG to override detected language (Jingjie Jiang) Symbolic links handling (Jingjie Jiang) Matthieu Caneill Debsources MiniDebconf, April / 48
53 What s new? And many many other features... Refactoring Debsources as a top-level Python module Configuration loader Flake8 compliance (Zack, Jingjie Jiang, and others) Test coverage (Jingjie Jiang, Clément Schreiner, and others) Case-insensitive package name search (Akshita Jha)?lang=LANG to override detected language (Jingjie Jiang) Symbolic links handling (Jingjie Jiang) Better statistics charts (Orestis Ioannou) Matthieu Caneill Debsources MiniDebconf, April / 48
54 What s new? And many many other features... Refactoring Debsources as a top-level Python module Configuration loader Flake8 compliance (Zack, Jingjie Jiang, and others) Test coverage (Jingjie Jiang, Clément Schreiner, and others) Case-insensitive package name search (Akshita Jha)?lang=LANG to override detected language (Jingjie Jiang) Symbolic links handling (Jingjie Jiang) Better statistics charts (Orestis Ioannou) Python3 support (Zack) Matthieu Caneill Debsources MiniDebconf, April / 48
55 Roadmap Static analysis Automatic runs of static analysis tools (e.g. clang, coccinelle) on all Debian packages Statistics gathering on bugs evolution Debile, Firewoes Matthieu Caneill Debsources MiniDebconf, April / 48
56 Roadmap Static analysis Automatic runs of static analysis tools (e.g. clang, coccinelle) on all Debian packages Statistics gathering on bugs evolution Debile, Firewoes copyright.debian.net Web application What is the license of package X? Is it compatible with package Y? Licenses searching/browsing Statistics gathering Matthieu Caneill Debsources MiniDebconf, April / 48
57 Roadmap And many smaller items more live stats Matthieu Caneill Debsources MiniDebconf, April / 48
58 Roadmap And many smaller items more live stats file name search Matthieu Caneill Debsources MiniDebconf, April / 48
59 Roadmap And many smaller items more live stats file name search binary package source package redirection Matthieu Caneill Debsources MiniDebconf, April / 48
60 Roadmap And many smaller items more live stats file name search binary package source package redirection tarball-in-tarball support Matthieu Caneill Debsources MiniDebconf, April / 48
61 Roadmap And many smaller items more live stats file name search binary package source package redirection tarball-in-tarball support 100% test suite coverage Matthieu Caneill Debsources MiniDebconf, April / 48
62 Roadmap And many smaller items more live stats file name search binary package source package redirection tarball-in-tarball support 100% test suite coverage file-level deduplication select count( ) from checksums; select count(distinct sha256) from checksums; deduplicated core: 45% Matthieu Caneill Debsources MiniDebconf, April / 48
63 Table of contents 1 Introduction 2 Features Debsources features What s new? Roadmap 3 Technologies 4 Research platform 5 Hacking Matthieu Caneill Debsources MiniDebconf, April / 48
64 Technologies What languages and technologies do we use? Code base: (almost) entirely in Python Matthieu Caneill Debsources MiniDebconf, April / 48
65 Technologies What languages and technologies do we use? Code base: (almost) entirely in Python Web application: Flask framework, Jinja2 templates, HTML/CSS/Javascript Matthieu Caneill Debsources MiniDebconf, April / 48
66 Technologies What languages and technologies do we use? Code base: (almost) entirely in Python Web application: Flask framework, Jinja2 templates, HTML/CSS/Javascript Database: PostgreSQL Matthieu Caneill Debsources MiniDebconf, April / 48
67 Technologies What languages and technologies do we use? Code base: (almost) entirely in Python Web application: Flask framework, Jinja2 templates, HTML/CSS/Javascript Database: PostgreSQL Apache web server, SQLAlchemy,... Matthieu Caneill Debsources MiniDebconf, April / 48
68 Overview Architecture Matthieu Caneill Debsources MiniDebconf, April / 48
69 Overview data model (excerpt) checksums* id serial PK package_id int file_id int FK sha256 varchar files serial id PK package_id int FK ctags* path bytea id serial PK package_id int FK tag varchar file_id int FK metrics line int id serial PK kind varchar package_id int FK language lang_ctags metric metric_type value_ int packages id serial PK version varchar name_id int FK area varchar sticky boolean package_names id serial PK name varchar sloccounts* id serial PK package_id int FK language lang_sloc count int suites id serial PK package_id int FK suite varchar table rows 1 suites info 16 package names 29,286 (source) packages 83,597 suites (mapping) 120,550 metrics (e.g., du) 83,597 sloccounts 298,360 checksums 35,370,653 ctags 358,773,259 1 snapshot, 31 July 2014 Matthieu Caneill Debsources MiniDebconf, April / 48
70 Disk usage unpacked sources: PostgreSQL DB: Source mirror: Hosting requirements: 609 GB 111 GB 71 GB 800 GB (31 July 2014) Matthieu Caneill Debsources MiniDebconf, April / 48
71 Disk usage unpacked sources: PostgreSQL DB: Source mirror: Hosting requirements: 609 GB 111 GB 71 GB 800 GB (31 July 2014) Figure: unpacked sources trend (peek due to archive.d.o injection) Matthieu Caneill Debsources MiniDebconf, April / 48
72 Table of contents 1 Introduction 2 Features Debsources features What s new? Roadmap 3 Technologies 4 Research platform 5 Hacking Matthieu Caneill Debsources MiniDebconf, April / 48
73 Research platform Facts Debsources is a huge software collection. Homogeneous: all software follow Debian s packaging format. It is up-to-date. Matthieu Caneill Debsources MiniDebconf, April / 48
74 Research platform Facts Debsources is a huge software collection. Homogeneous: all software follow Debian s packaging format. It is up-to-date. Software evolution 20 years of source code evolution. Plugins to compute stats. Matthieu Caneill Debsources MiniDebconf, April / 48
75 Research platform Facts Debsources is a huge software collection. Homogeneous: all software follow Debian s packaging format. It is up-to-date. Software evolution 20 years of source code evolution. Plugins to compute stats. Nice charts can be computed with this! Example: What are the trending programming languages? Matthieu Caneill Debsources MiniDebconf, April / 48
76 Research platform Software metrics evolution over Debian releases Matthieu Caneill Debsources MiniDebconf, April / 48
77 Research platform File size per language, evolution over Debian releases Matthieu Caneill Debsources MiniDebconf, April / 48
78 Research platform Absolute evolution of SLOC per language, over Debian releases Matthieu Caneill Debsources MiniDebconf, April / 48
79 Research platform Relative evolution of SLOC per language, over Debian releases Matthieu Caneill Debsources MiniDebconf, April / 48
80 Research platform Publications Matthieu Caneill, Stefano Zacchiroli. Debsources: Live and Historical Views on Macro-Level Software Evolution. In proceedings of ESEM 2014: 8th International Symposium on Empirical Software Engineering and Measurement. Stefano Zacchiroli. The Debsources Dataset: Two Decades of Debian Source Code Metadata. To appear in proceedings of MSR 2015: The 12th Working Conference on Mining Software Repositories. You can find the PDFs of the articles on Matthieu Caneill Debsources MiniDebconf, April / 48
81 Table of contents 1 Introduction 2 Features Debsources features What s new? Roadmap 3 Technologies 4 Research platform 5 Hacking Matthieu Caneill Debsources MiniDebconf, April / 48
82 Hacking How can I contribute? Step 1: clone Debsources git repository git clone git://anonscm.debian.org/qa/debsources.git Matthieu Caneill Debsources MiniDebconf, April / 48
83 Hacking How can I contribute? Step 1: clone Debsources git repository git clone git://anonscm.debian.org/qa/debsources.git Step 2: Set-up a development environment Follow the instructions in the HACKING file, Or docker run! Will setup a Docker container with all batteries included: dependencies, database, test data, configuration. Matthieu Caneill Debsources MiniDebconf, April / 48
84 Hacking How can I contribute? Step 1: clone Debsources git repository git clone git://anonscm.debian.org/qa/debsources.git Step 2: Set-up a development environment Follow the instructions in the HACKING file, Or docker run! Will setup a Docker container with all batteries included: dependencies, database, test data, configuration. Step 3: open your editor and hack! Bugs list: qa.debian.org;tag=debsources or: implement your own plugin (see examples), add features, etc. Matthieu Caneill Debsources MiniDebconf, April / 48
85 Thanks! Questions? Matthieu Caneill Slides: derived from Stefano Zacchiroli Licensed CC-BY-SA.
Debsources as a Platform
Debsources as a Platform All your Debian source are belong to us! Stefano Zacchiroli, Matthieu Caneill August 18, 2015 DebConf15 (Heidelberg, Germany) Acknowledgements Code Initially developped at IRILL,
Android InsecureBankv2 Usage Guide. InsecureBankv2
Android InsecureBankv2 Usage Guide Author Name Email ID GitHub Link Twitter Dinesh Shetty dinezh.shetty@gmail.com https://github.com/dineshshetty/android- InsecureBankv2 https://twitter.com/din3zh Usage
Optimizing Docker Images
Optimizing Docker Images Brian DeHamer - CenturyLink Labs bdehamer CenturyLinkLabs @bdehamer @centurylinklabs Overview Images & Layers Minimizing Image Size Leveraging the Image Cache Dockerfile Tips
Exercises. Cacti Installation and Configuration
Exercises Cacti Installation and Configuration Exercises Your Mission... Install Cacti Create device entry for your local router Create device entries for your local servers Create entries for class router
Exercises. Cacti Installation and Configuration
Exercises Cacti Installation and Configuration Exercises Your Mission... Install Cacti Create device entry for your local router Create device entries for your local servers Create entries for class router
packaging the free so ware web for the end user Antonio Terceiro
packaging the free so ware web for the end user Antonio Terceiro terceiro@debian.org thoughts on debconf15 the venue is really nice kids + families = late night hacking means no morning briefings for
Software Heritage. Preserving the Free Software Commons. Roberto Di Cosmo and Stefano Zacchiroli.
Software Heritage Preserving the Free Software Commons Roberto Di Cosmo and Stefano Zacchiroli roberto@dicosmo.org,zack@upsilon.cc 4 February 2017 FOSDEM 17 Brussels, Belgium R. Di Cosmo, S. Zacchiroli
chatterbot-weather Documentation
chatterbot-weather Documentation Release 0.1.1 Gunther Cox Nov 23, 2018 Contents 1 chatterbot-weather 3 1.1 Installation................................................ 3 1.2 Example.................................................
Pulp Python Support Documentation
Pulp Python Support Documentation Release 1.0.1 Pulp Project October 20, 2015 Contents 1 Release Notes 3 1.1 1.0 Release Notes............................................ 3 2 Administrator Documentation
Introduction to SPDX. Kate Stewart 5 November 2015
Introduction to SPDX Kate Stewart 5 November 2015 What is SPDX? Standard: A standard format for communicating the licenses and copyrights associated with software packages Guiding principles: Human and
24 th Annual Research Review
24 th Annual Research Review April 4-6 2017 Towards Better Understanding of Software Quality Evolution Through Commit-Impact Analysis Pooyan Behnamghader USC CSSE pbehnamg@usc.edu Commit-Impact Analysis
CIS : Computational Reproducibility
CIS 602-01: Computational Reproducibility Containers and Reproducibility Dr. David Koop The Problem Matrix [Docker, Inc., 2016] 2 Shipping Analogy [Docker, Inc., 2016] 3 The Solution: Containers [Docker,
Game Server Manager Documentation
Game Server Manager Documentation Release 0.1.1+0.gc111f9c.dirty Christopher Bailey Dec 16, 2017 Contents 1 Game Server Manager 3 1.1 Requirements............................................... 3 1.2
sainsmart Documentation
sainsmart Documentation Release 0.3.1 Victor Yap Jun 21, 2017 Contents 1 sainsmart 3 1.1 Install................................................... 3 1.2 Usage...................................................
Organization, Structure, and How To Contribute
Organization, Structure, and How To Contribute Don Armstrong Debian Developer April 5th, 2012 1 Debian Project History Beginnings Release History Growth 2 Organization of Debian Principles Debian Social
Computational and cognitive neuroscience boosted by Debian
Computational and cognitive neuroscience boosted by Debian Michael Hanke Debian Developer, Otto-von-Guericke University of Magdeburg Debian for Scientific Facilities Days European Synchrotron Radiation
Python Project Example Documentation
Python Project Example Documentation Release 0.1.0 Neil Stoddard Mar 22, 2017 Contents 1 Neilvana Example 3 1.1 Features.................................................. 3 1.2 Credits..................................................
Extending Java TM TM And Developing DSLs With JetBrains MPS Open- Source Language Workbench
Extending Java TM TM And Developing DSLs With JetBrains MPS Open- Source Language Workbench Konstantin Solomatov JetBrains Lead Developer for JetBrains MPS Project 1 Agenda > Extending languages. Why bother?
ovirt and Docker Integration
ovirt and Docker Integration October 2014 Federico Simoncelli Principal Software Engineer Red Hat 1 Agenda Deploying an Application (Old-Fashion and Docker) Ecosystem: Kubernetes and Project Atomic Current
swiftenv Documentation
swiftenv Documentation Release 1.3.0 Kyle Fuller Sep 27, 2017 Contents 1 The User Guide 3 1.1 Installation................................................ 3 1.2 Getting Started..............................................
OpenShift Roadmap Enterprise Kubernetes for Developers. Clayton Coleman, Architect, OpenShift
OpenShift Roadmap Enterprise Kubernetes for Developers Clayton Coleman, Architect, OpenShift What Is OpenShift? Application-centric Platform INFRASTRUCTURE APPLICATIONS Use containers for efficiency Hide
Python data pipelines similar to R Documentation
Python data pipelines similar to R Documentation Release 0.1.0 Jan Schulz October 23, 2016 Contents 1 Python data pipelines 3 1.1 Features.................................................. 3 1.2 Documentation..............................................
The why and how of getting packaged
The why and how of getting packaged Michael Hanke Debian Developer Otto-von-Guericke University, Magdeburg 5th BrainScaleS CodeJam Mar 15th 2012 M. Hanke (Debian/OvGU) Getting packaged CodeJam5 1 / 23
Full Stack Web Developer Nanodegree Syllabus
Full Stack Web Developer Nanodegree Syllabus Build Complex Web Applications Before You Start Thank you for your interest in the Full Stack Web Developer Nanodegree! In order to succeed in this program,
Intro Git Advices. Using Git. Matthieu Moy. Matthieu Moy Git 2016 < 1 / 11 >
Using Git Matthieu Moy Matthieu.Moy@imag.fr 2016 Matthieu Moy (Matthieu.Moy@imag.fr) Git 2016 < 1 / 11 > Outline 1 Revision Control System 2 Git: Basic Principles 3 Advices Using Git Matthieu Moy (Matthieu.Moy@imag.fr)
APEX Times Ten Berichte. Tuning DB-Browser Datenmodellierung Schema Copy & Compare Data Grids. Extension Exchange.
Oracle SQL Developer 3.0 Data Mining Debugging Code Snippets DBA-Navigator APEX Times Ten Berichte Unit Tests Migration Workbench Versionskontrolle Extension Exchange Tuning DB-Browser
PL/SQL Developer and TOAD IDE Integration Configuration
PL/SQL Developer and TOAD IDE Integration Configuration SCM Solutions provides this document as a guideline only and does not guarantee error free usage of either ID integration solutions discussed in
I2C LCD Documentation
I2C LCD Documentation Release 0.1.0 Peter Landoll Sep 04, 2017 Contents 1 I2C LCD 3 1.1 Features.................................................. 3 1.2 Credits..................................................
nacelle Documentation
nacelle Documentation Release 0.4.1 Patrick Carey August 16, 2014 Contents 1 Standing on the shoulders of giants 3 2 Contents 5 2.1 Getting Started.............................................. 5 2.2
IBM Rational Rhapsody Gateway Add On. Tagger Manual
Tagger Manual Rhapsody IBM Rational Rhapsody Gateway Add On Tagger Manual License Agreement No part of this publication may be reproduced, transmitted, stored in a retrieval system, nor translated into
gedit developer plugins Configuring and extending gedit for development
gedit developer plugins Configuring and extending gedit for development What is gedit? gedit is a simple text editor with support for syntax highlighting that can be extended for new uses See https://live.gnome.org/gedit
Firefox quality. Mozilla Paris FOSDEM Feb 3rd 2018
Firefox quality Mozilla Paris FOSDEM Feb 3rd 2018 Bonjour! Je suis Sylvestre Ledru Je parle de Firefox Quality Twitter @SylvestreLedru 2 Bonjour! 3 Bonjour! 4 Bonjour! 5 The Firefox scale About:Firefox
Belle II - Git migration
Belle II - Git migration Why git? Stash GIT service managed by DESY Powerful branching and merging capabilities Resolution of (JIRA) issues directly be map to branches and commits Feature freeze in pre-release
What s new in IBM Operational Decision Manager 8.9 Standard Edition
What s new in IBM Operational Decision Manager 8.9 Standard Edition Release themes User empowerment in the Business Console Improved development and operations (DevOps) features Easier integration with
New IDE Application Profiler Enhancements
New IDE Application Profiler Enhancements Authored by: Elena Laskavaia The new Application Profiler features are currently under development for the next release of QNX Momentics. Use the forum and provide
Kernel maintainership: an oral tradition
Embedded Linux Conference Europe 2015 Kernel maintainership: an oral tradition Gregory CLEMENT Bootlin gregory.clement@bootlin.com (Image credit: Andrew Cheal under license CC BY-ND 2.0) - Kernel, drivers
An Introduction to Eclipse Che Lets build a custom cloud IDE. October 2015 Tyler Jewell, Eclipse Che Project
An Introduction to Eclipse Che Lets build a custom cloud IDE October 2015 Tyler Jewell, Eclipse Che Project Lead @TylerJewell Goal Let anyone contribute to any project anywhere at any time. no pre-installation
I hate money. Release 1.0
I hate money Release 1.0 Nov 01, 2017 Contents 1 Table of content 3 2 Indices and tables 15 i ii «I hate money» is a web application made to ease shared budget management. It keeps track of who bought
User Workspace Management
Access the Interface, page 1 User Management Workspace User Types, page 4 Projects (Admin User), page 5 Users (Admin User), page 9 CML Server (Admin User), page 11 Connectivity, page 30 Using the VM Control
GMusicProcurator Documentation
GMusicProcurator Documentation Release 0.5.0 Mark Lee Sep 27, 2017 Contents 1 Features 3 2 Table of Contents 5 2.1 Installation................................................ 5 2.1.1 Requirements..........................................
invenio-formatter Documentation
invenio-formatter Documentation Release 1.0.0 CERN Mar 25, 2018 Contents 1 User s Guide 3 1.1 Installation................................................ 3 1.2 Configuration...............................................
Developers Care About the License Using SPDX to Describe License Information. Jilayne Lovejoy 6 October 2015
Developers Care About the License Using SPDX to Describe License Information Jilayne Lovejoy 6 October 2015 sharing code! Developers care about the license How do we share? 2 CC0 from Pixabay 3 How do
Advanced Linux System Administra3on
Advanced Linux System Administra3on Topic 4. So=ware management Pablo Abad Fidalgo José Ángel Herrero Velasco Departamento de Ingeniería Informá2ca y Electrónica Este tema se publica bajo Licencia: Crea2ve
Redis Timeseries Documentation
Redis Timeseries Documentation Release 0.1.8 Ryan Anguiano Jul 26, 2017 Contents 1 Redis Timeseries 3 1.1 Install................................................... 3 1.2 Usage...................................................
manifold Documentation
manifold Documentation Release 0.0.1 Open Source Robotics Foundation Mar 04, 2017 Contents 1 What is Manifold? 3 2 Installation 5 2.1 Ubuntu Linux............................................... 5 2.2
Release Nicholas A. Del Grosso
wavefront r eaderdocumentation Release 0.1.0 Nicholas A. Del Grosso Apr 12, 2017 Contents 1 wavefront_reader 3 1.1 Features.................................................. 3 1.2 Credits..................................................
Preserving Source Code
Preserving Source Code Challenges and Opportunities for the Reproductibility of Science Stefano Zacchiroli University Paris Diderot & Inria zack@upsilon.cc 25 May 2017 DAUIN, Politecnico di Torino Turin,
Android Sdk Install Documentation Eclipse. Ubuntu >>>CLICK HERE<<<
Android Sdk Install Documentation Eclipse Ubuntu 12.04 These are instructions to install the Android SDK onto Ubuntu. If you are only I'm skipping the Eclipse install, sorry if you wanted. Just trying
APEX Developer Guide. Sven van der Meer, Liam Fallon, John Keeney. Version SNAPSHOT, T11:44:57Z
APEX Developer Guide Sven van der Meer, Liam Fallon, John Keeney Version 2.1.0-SNAPSHOT, 2018-11-30T11:44:57Z Table of Contents 1. Build APEX from Source..................................................................................
Perl Validate Xml Against Schema Visual Studio
Perl Validate Xml Against Schema Visual Studio Before the file is processed, it is validated against schema. So, my question is, Merging XML files using external entities in Visual Studio 2008 1 How do
Hawk Server for Linux. Installation Guide. Beta Version MHInvent Limited. All rights reserved.
Hawk Server for Linux Installation Guide Beta Version Hawk Server Introduction Thank you for being part of the beta program for Hawk Secure Browser! This installation document will guide you through the
Quick housekeeping Last Two Homeworks Extra Credit for demoing project prototypes Reminder about Project Deadlines/specifics Class on April 12th Resul
CIS192 Python Programming Web Frameworks and Web APIs Harry Smith University of Pennsylvania March 29, 2016 Harry Smith (University of Pennsylvania) CIS 192 March 29, 2016 1 / 25 Quick housekeeping Last
Using git to download and update BOUT++
ER Meeting 14th Sept 2015 1/28 Using git to download and update BOUT++ Peter Hill ER Meeting 14th Sept 2015 2/28 Outline What is git? Getting git Basic git usage Getting BOUT++ Compiling BOUT++ Running
AIL Framework for Analysis of Information Leaks
AIL Framework for Analysis of Information Leaks hack.lu workshop - A generic analysis information leak open source software Alexandre Dulaunoy alexandre.dulaunoy@circl.lu Sami Mokaddem sami.mokaddem@circl.lu
Python Schema Generator Documentation
Python Schema Generator Documentation Release 1.0.0 Peter Demin June 26, 2016 Contents 1 Mutant - Python code generator 3 1.1 Project Status............................................... 3 1.2 Design..................................................
HPO Workbench Documentation
HPO Workbench Documentation Release 1 Monarch Initiative Dec 10, 2018 Contents: 1 Installing and running HPO Workbench 1 1.1 Mac OSX................................................. 1 1.2 Windows.................................................
Install your scientific software stack easily with Spack
Install your scientific software stack easily with Spack Les mardis du développement technologique Florent Pruvost (SED) Outline 1. Context 2. Features overview 3. In practice 4. Some feedback Florent
Harbor Registry. VMware VMware Inc. All rights reserved.
Harbor Registry VMware 2017 VMware Inc. All rights reserved. VMware Harbor Registry Cloud Foundry Agenda 1 Container Image Basics 2 Project Harbor Introduction 3 Consistency of Images 4 Security 5 Image
Having Fun with Social Coding. Sean Handley. February 25, 2010
Having Fun with Social Coding February 25, 2010 What is Github? GitHub is to collaborative coding, what Facebook is to social networking 1 It serves as a web front-end to open source projects by allowing
pydrill Documentation
pydrill Documentation Release 0.3.4 Wojciech Nowak Apr 24, 2018 Contents 1 pydrill 3 1.1 Features.................................................. 3 1.2 Installation................................................
Connexion Sqlalchemy Utils Documentation
Connexion Sqlalchemy Utils Documentation Release 0.1.4 Michael Housh Apr 17, 2017 Contents 1 Connexion Sqlalchemy Utils 3 1.1 Features.................................................. 3 1.2 Running example
About the Tutorial. Audience. Prerequisites. Copyright and Disclaimer. Logstash
About the Tutorial is an open-source, centralized, events and logging manager. It is a part of the ELK (ElasticSearch,, Kibana) stack. In this tutorial, we will understand the basics of, its features,
FOSSology Project Information
FOSSology Project Information Project Home: www.fossology.org Developers information: github.com/fossology/fossology/wiki FOSSology Source: github.com/fossology/fossology Status: tagged 3.1-rc2 Mail lists:
dbdeployer the future of MySQL sandboxes Giuseppe Maxia Software explorer
dbdeployer the future of MySQL sandboxes Giuseppe Maxia Software explorer About me Who's this guy? Giuseppe Maxia, a.k.a. "The Data Charmer" Software Explorer at VMware Several decades development and
LAB MANUAL GIT BY PRATIK JAIN. To start with git bash, we need to authenticate ourselves so that for every commit, git can use this information.
LAB MANUAL GIT BY PRATIK JAIN STARTING WITH GIT : To start with git bash, we need to authenticate ourselves so that for every commit, git can use this information. We can remove -- global option to override
New Contributor Tutorial and Best Practices
New Contributor Tutorial and Best Practices Vicențiu Ciorbaru Software Engineer @ MariaDB Foundation * 2018 MariaDB Foundation * Goal of this session Most attendees here are highly experienced devs Let's
Niv Mizrahi. VP github.com/nivm
Python Packaging Niv Mizrahi VP R&D @ emedgene @ravinizme github.com/nivm Python We Love Python Python The syntax is simple and expressive, it has tons of open source modules and frameworks and a great
Deby - Reproducible and Maintainable Embedded Linux Environment with Poky
Deby - Reproducible and Maintainable Embedded Linux Environment with Poky Kazuhiro Hayashi CE Workgroup, The Linux Foundation (TOSHIBA Corporation) Embedded Linux Conference Europe 2016 Oct 12, 2016 About
Sonatype CLM - IDE User Guide. Sonatype CLM - IDE User Guide
Sonatype CLM - IDE User Guide i Sonatype CLM - IDE User Guide Sonatype CLM - IDE User Guide ii Contents 1 Introduction 1 2 Installing Sonatype CLM for Eclipse 2 3 Configuring Sonatype CLM for Eclipse 5
Deep Dive Amazon Kinesis. Ian Meyers, Principal Solution Architect - Amazon Web Services
Deep Dive Amazon Kinesis Ian Meyers, Principal Solution Architect - Amazon Web Services Analytics Deployment & Administration App Services Analytics Compute Storage Database Networking AWS Global Infrastructure
Notepad++ The COMPSCI 101 Text Editor for Windows. What is a text editor? Install Python 3. Installing Notepad++
Notepad++ The COMPSCI 101 Text Editor for Windows The text editor that we will be using in the Computer Science labs for creating our Python programs is called Notepad++ and is freely available for the
Soar IDE. Keith Knudsen, Mike Quist, Dave Ray & Bob Wray May 24, 2007
Soar IDE Keith Knudsen, Mike Quist, Dave Ray & Bob Wray {knudsen,ray,quist} @soartech.com May 24, 2007 Soar Editors and Development Environments A (very incomplete) list of development support tools for
Studio Cloud. Frictionless onboarding to data science with. Mine Çetinkaya-Rundel Duke University + RStudio
Frictionless onboarding to data science with Studio Cloud @minebocek mine-cetinkaya-rundel mine@stat.duke.edu Mine Çetinkaya-Rundel Duke University + RStudio don t start like this - Install R - Install
Towards Better Understanding of Software Quality Evolution Through Commit Impact Analysis
Towards Better Understanding of Software Quality Evolution Through Commit Impact Analysis Sponsor: DASD(SE) By Mr. Pooyan Behnamghader 5 th Annual SERC Doctoral Students Forum November 7, 2017 FHI 360
1.Introduction to ThingSpeak platform
IoT laboratory 2. In the IoT laboratory 1. a sensors and an actuator were connected to the Internet in order to push data to an application and take control for the device. This time, at the laboratory
Vim-Mahewin-Repository Documentation
Vim-Mahewin-Repository Documentation Release 0.1 Hobbestigrou Aug 29, 2017 Contents 1 Install 3 1.1 Using curl................................................ 3 1.2 Using wget................................................
Scientific Software Development with Eclipse
Scientific Software Development with Eclipse A Best Practices for HPC Developers Webinar Gregory R. Watson ORNL is managed by UT-Battelle for the US Department of Energy Contents Downloading and Installing
Code::Blocks Student Manual
Code::Blocks Student Manual Lawrence Goetz, Network Administrator Yedidyah Langsam, Professor and Theodore Raphan, Distinguished Professor Dept. of Computer and Information Science Brooklyn College of
Integrating Condor into the Debian operating system
Integrating Condor into the Debian operating system Michael Hanke Debian Developer, Dartmouth College CondorWeek, University of Wisconsin Madison, Wisconsin May 4th 2011 Michael Hanke (Debian) Integrating
Structure and Config
Ubuntu Linux Server Structure and Config interlab at AIT Network Management Workshop March 11 Hervey Allen What's Our Goal? A bit of Debian & Ubuntu philosophy Differences from the Red Hat world Package
BigFix 2018 Roadmap. Aram Eblighatian. Product Manager IBM BigFix. 14 May, 2018
BigFix 2018 Roadmap Aram Eblighatian Product Manager IBM BigFix 14 May, 2018 What's New in BigFix? BigFix Platform BigFix Platform v9.5.7 Released Oct. 2017 Gathering Performance improvements (WebUI and
# Project Tracker Parent task Status Priority Subject Updated Target version. hosts view. permissions. configured speed. afftected 19/11/2014 1/5
OpMon - Issues # Project Tracker Parent task Status Priority Subject Updated Target 4373 OpMon User story Resolved Normal Allow scheduled downtimes are added with past start date. 13/08/2014 10:03 6.1.7
TORRENT ARCGIS DEVELOPERS FOR VBA USER MANUAL E-PUB
26 April, 2018 TORRENT ARCGIS DEVELOPERS FOR VBA USER MANUAL E-PUB Document Filetype: PDF 411.2 KB 0 TORRENT ARCGIS DEVELOPERS FOR VBA USER MANUAL E-PUB This service pack should be installed as the ArcGIS
AIL Framework for Analysis of Information Leaks
AIL Framework for Analysis of Information Leaks Workshop - A generic analysis information leak open source software Sami Mokaddem sami.mokaddem@circl.lu Aurélien Thirion info@circl.lu July 2, 2018 2 of
Eclipse Lyo Overview. Michael Fiedler, Eclipse Lyo committer IBM Corporation
Eclipse Lyo Overview http://eclipse.org/lyo Michael Fiedler, Eclipse Lyo committer 1 Agenda Eclipse Lyo background Content and Plans Test Suites OSLC4J Samples Next Steps 2 OSLC Specifications OSLC Core
Git. Ľubomír Prda. IT4Innovations.
Git Ľubomír Prda IT4Innovations lubomir.prda@vsb.cz support@it4i.cz VCS Version Control System Versioning - creation and management of multiple releases of a product, all of which have the same general
Composer Guide for JavaScript Development
IBM Initiate Master Data Service Version 10 Release 0 Composer Guide for JavaScript Development GI13-2630-00 IBM Initiate Master Data Service Version 10 Release 0 Composer Guide for JavaScript Development
JetBrains TeamCity Comparison
JetBrains TeamCity Comparison TeamCity is a continuous integration and continuous delivery server developed by JetBrains. It provides out-of-the-box continuous unit testing, code quality analysis, and
There Should be One Obvious Way to Bring Python into Production. Sebastian Neubauer
There Should be One Obvious Way to Bring Python into Production Sebastian Neubauer sebastian.neubauer@blue-yonder.com 1 Agenda What are we talking about and why? Delivery pipeline Dependencies Packaging
Continuous Integration & Code Quality MINDS-ON NUNO 11 APRIL 2017
Continuous Integration & Code Quality MINDS-ON NUNO BETTENCOURT (NMB@ISEP.IPP.PT) @DEI, 11 APRIL 2017 Continuous Integration - THE THEORY - NMB@DEI - 11 April, 2017 CONTINUOUS INTEGRATION & SOFTWARE QUALITY
Javadoc. Computer Science and Engineering College of Engineering The Ohio State University. Lecture 7
Javadoc Computer Science and Engineering College of Engineering The Ohio State University Lecture 7 Motivation Over the lifetime of a project, it is easy for documentation and implementation to diverge
Status.out and Debugging SWAMP Failures. James A. Kupsch. Version 1.0.2, :14:02 CST
Status.out and Debugging SWAMP Failures James A. Kupsch Version 1.0.2, 2017-01-17 14:14:02 CST Table of Contents 1. Introduction.............................................................................
Static Code Analysis in ATLAS. Andrew Washbrook University of Edinburgh Common discussion about software quality analysis 23rd November 2016
Static Code Analysis in ATLAS Andrew Washbrook University of Edinburgh Common discussion about software quality analysis 23rd November 2016 Coverity Commercial static code analysis (and security testing)
Live Guide Co-browsing
TECHNICAL PAPER Live Guide Co-browsing Netop develops and sells software solutions that enable swift, secure and seamless transfer of video, screens, sounds and data between two or more computers over
ANSIBLE BEST PRACTICES: THE ESSENTIALS Ansible Automates: DC. Jamie
ANSIBLE BEST PRACTICES: THE ESSENTIALS Ansible Automates: DC Jamie Duncan @jamieeduncan cloudguy@redhat.com about jduncan 6+ years with Red Hat Coming Soon #shamelessplug 2 My daughter Elizabeth #cutestthingever
Simple libtorrent streaming module Documentation
Simple libtorrent streaming module Documentation Release 0.1.0 David Francos August 31, 2015 Contents 1 Simple libtorrent streaming module 3 1.1 Dependences...............................................
Adaptive Android Kernel Live Patching
USENIX Security Symposium 2017 Adaptive Android Kernel Live Patching Yue Chen 1, Yulong Zhang 2, Zhi Wang 1, Liangzhao Xia 2, Chenfu Bao 2, Tao Wei 2 Florida State University 1 Baidu X-Lab 2 Android Kernel
Google Domain Shared Contacts Client Documentation
Google Domain Shared Contacts Client Documentation Release 0.1.0 Robert Joyal Mar 31, 2018 Contents 1 Google Domain Shared Contacts Client 3 1.1 Features..................................................
Package Tracking System Hacking's guide
Package Tracking System Hacking's guide By Raphaël Hertzog September 2005 in Darmstadt Debian-QA mini-conference Plan Introduction Where to get the sources Directory overview The mail
Micro Focus Enterprise View. Installing Enterprise View
Micro Focus Enterprise View Installing Enterprise View Micro Focus The Lawn 22-30 Old Bath Road Newbury, Berkshire RG14 1QN UK http://www.microfocus.com Copyright Micro Focus 2009-2014. All rights reserved.