mozilla

Mozilla Nederland LogoDe Nederlandse
Mozilla gemeenschap

Mozilla names Chris Beard its new CEO after Brendan Eich disaster - SmartCompany.com.au

Nieuws verzameld via Google - di, 29/07/2014 - 03:50

SmartCompany.com.au

Mozilla names Chris Beard its new CEO after Brendan Eich disaster
SmartCompany.com.au
Mozilla has finally named a new chief executive nearly four months after a firestorm of controversy engulfed the leadership of Brendan Eich within days of him taking the position. In a statement, Mozilla co-founder and chairwoman Mitchell Baker ...

Google Nieuws
Categorieën: Mozilla-nl planet

Raluca Podiuc: AF (analysis framework) and the task graph story

Mozilla planet - di, 29/07/2014 - 02:41
Analysis Framework is an application written on top of TaskCluster and provides a way to execute Telemetry MapReduce jobs.

AF comprises two modules:
  
Telemetry-analysis-base
This module contains an example of a MapReduce node that can be executed over TaskCluster.
It contains:
  •  a custom specification for a Docker image
  •  a Makefile for creating a Docker image and posting it on registry
  •  a Vagrantfile useful to developers working on MACOSX
  •  custom code for map/reduce jobs
  •  an encryption module used to decrypt STS temporary credentials

 A task up and running
 

In order to run a task on TaskCluster you need a Docker container, and a custom code to be executed in the container.
 A Docker container is a Docker image in execution. To obtain a custom image you can use the Docker specification in the telemetry-analysis-base repository.
 As TaskCluster needs a container to run your task in, you need to push your container on TaskCluster registry. The Makefile present in the repository takes care of creating a container and pushing it on the registry.

Because Telemetry jobs work with data that is not open to the public you need a set of credentials to access the files in S3. The Docker container expects a set of encrypted temporary credentials as an environment variable called CREDENTIALS.
As these credentials are visible in the task description on TaskCluster they are encrypted and base64 encoded. The temporary credentials used are STS Federation Token credentials. These credentials expire in 36 hours and can be obtain only by AWS users that hold a policy to generate them.
After obtaining this credentials they are encrypted with a symmetric key. The symmetric key is encrypted with a public key and sent together as an environment variable to the Docker instance. Inside the Docker container this credentials will be decrypted properly and used to make calls in S3.

Custom code

Inside the custom container resides the custom code that will receive as arguments a set of file names in S3.

Mapper

After decrypting the credentials the mapper will take the file list and start downloading a batch of files in parallel. As files finish downloading they are stored in a directory called s3/<path is S3> and their names are sent as arguments to the mapperDriver.
MapperDriver will first read the specification of the job from analysis-tools.yml. In the configuration file it is specified if the files need to be decompressed, the mapper function that needs to run and also the language that the mapper is written in.
Next, as the example provided in the repository is in python, the driver spawns another process that executes python-helper-mapper that reads the files, decompresses them, loads the mapper function and sends the decompressed files line by line to the mapper function.
In the mapper function the output is written to result.txt. This file is an artifact for the task ran.

Reducer

The reducer task requires an environment variable named INPUT_TASK_IDS specifying all the mapper task ids. Holding the list of all mappers the reducer makes calls to get all the result files from the mappers. As the files finish to download they are stored in a folder called mapperOutput.
The reducerDriver than reads the specification of the job from analysis-tools.yml. The analysis-tools.yml contains the reducer function name and the language that is written in.
In the example provided in the repository the reducer is also written in python so it uses an intermediary module called python-helper-reducer. This module loads the reducer, removes all empty lines from the result files and feeds them to the reducer function.
The output is written to the result file that is an artifact of the reducer task. After writing the result file, the reducer sends an email to the owner of the task. This mail contains a link to the output of the MapReduce job. The email address will be given as an environment variable called OWNER.



Telemetry-analysis


This module constructs a taskGraph and posts it to TaskCluster.
At this point a set of credentials is needed to run a task graph:
  • credentials in AWS allowing Federation Token generation. To obtain them you need to specify  a policy enabling STS credentials generation.
  • public key associated to the private one residing in the running Docker container
  • symmetric key used to encrypt the Federation Token credentials
  • access to IndexDB
  • credentials to TaskCluster (in the future)


 Example call:

./AF.js Filter.json "registry.taskcluster.net/aaa" '{"OWNER" : "unicorn@mozilla.com", "BLACK" : "black"}'


 AF takes as arguments a Filter.json, a Docker image (registry.taskcluster.net/aaa) and optionally some other arguments that will be passed as environment variables to the Docker container.
AF executes the following:

  • makes a call for a Federation Token. It encrypts with the public key the credentials and provides base64 encrypted credentials as CREDENTIALS environment variable to the Docker container
  • using Filter.json AF queries indexDB to get the specific file names and file sizes
  • creates skeletons for  mapper tasks and adds load to them (file names from indexDB)
  • pushes taskDefinition to graph Skeleton
  • creates reducer task and gives it as dependencies the labels of dependent tasks
  • posts the graph
  • gets the graph definition, prints the graph definition and a link to a simple monitor page
  • as the graph finises execution, the page will contain the links to the result page

Last but not least


Analysis Framework is a really interesting/fun project. It can be easily extended or reused, it is designed as an example that can be customized and has some documentation too. :p




Categorieën: Mozilla-nl planet

Mozilla promotes interim CEO Chris Beard to permanent status - Digital Trends

Nieuws verzameld via Google - di, 29/07/2014 - 02:40

Digital Trends

Mozilla promotes interim CEO Chris Beard to permanent status
Digital Trends
“Chris has a keen sense of where Mozilla has been – and where we're headed,” Mitchell Baker, Mozilla's Executive Chairwoman said. “He has unique experience connecting with every constituency that touches our products, including consumers, partners ...

Categorieën: Mozilla-nl planet

Mozilla's interim CEO to assume role permanently - USA TODAY

Nieuws verzameld via Google - di, 29/07/2014 - 01:37

USA TODAY

Mozilla's interim CEO to assume role permanently
USA TODAY
"Over the years, Chris has led many of Mozilla's most innovative projects," said Mozilla executive chairwoman Mitchell Baker in a statement released Monday. "We have relied on his judgment and advice for nearly a decade. Chris has a clear vision of how ...
Mozilla Names Interim Chief Permanent CEOWall Street Journal
Mozilla: We're keeping the Beard – Brendan Eich successor now permanent pickRegister
Mozilla Names Chris Beard CEORe/code
Computerworld (blog) -Inquirer -V3.co.uk
alle 33 nieuwsartikelen »
Categorieën: Mozilla-nl planet

Mozilla Names Chris Beard CEO - Re/code

Nieuws verzameld via Google - di, 29/07/2014 - 00:21

Re/code

Mozilla Names Chris Beard CEO
Re/code
As the organization said in a blog post, Beard is a Mozilla veteran having jointed the organization in 2004 just before it shipped the first Firefox browser. He also spent a year as Executive-in-Residence at the venture capital firm Greylock Partners ...

Categorieën: Mozilla-nl planet

Kim Moir: 2014 USENIX Release Engineering Summit CFP now open

Mozilla planet - ma, 28/07/2014 - 23:28
The CFP for the 2014 Release Engineering summit (Western edition) is now open.  The deadline for submissions is September 5, 2014 and speakers will be notified by September 19, 2014.  The program will be announced in late September.  This one day summit on all things release engineering will be held in concert with LISA, in Seattle on November 10, 2014. 

Seattle skyline © Howard Ignatius, https://flic.kr/p/6tQ3H Creative Commons by-nc-sa 2.0

From the CFP

"Suggestions for topics include (but are not limited to):
  • Best practices for release engineering
  • Practical information on specific aspects of release engineering (e.g., source code management, dependency management, packaging, unit tests, deployment)
  • Future challenges and opportunities in release engineering
  • Solutions for scalable end-to-end release processes
  • Scaling infrastructure and tools for high-volume continuous integration farms
  • War and horror stories
  • Metrics
  • Specific problems and solutions for specific markets (mobile, financial, cloud)
URES '14 West is looking for relevant and engaging speakers and workshop facilitators for our event on November 10, 2014, in Seattle, WA. URES brings together people from all areas of release engineering—release engineers, developers, managers, site reliability engineers, and others—to identify and help propose solutions for the most difficult problems in release engineering today."

War and horror stories. I like to see that in a CFP.  Describing how you overcame problems with  infrastructure and tooling to ship software are the best kinds of stories.  They make people laugh. Maybe cry as they realize they are currently living in that situation.  Good times.  Also, I think talks around scaling high volume continuous integration farms will be interesting.  Scaling issues are a lot of fun and expose many issues you don't see when you're only running a few builds a day. 

If you have any questions surrounding the CFP, I'm happy to help as I'm on the program committee.   (my irc nick is kmoir (#releng) as is my email id at mozilla.com)
Categorieën: Mozilla-nl planet

Mozilla Promotes Interim Chief to CEO - PC Magazine

Nieuws verzameld via Google - ma, 28/07/2014 - 22:30

Mozilla Promotes Interim Chief to CEO
PC Magazine
Mozilla on Monday announced it has named Chris Beard as CEO. Beard has been serving as Mozilla's interim CEO since Brendan Eich resigned in April amidst controversy surrounding a donation he made to an anti-gay marriage ballot initiative. "The Mozilla ...

Categorieën: Mozilla-nl planet

Mozilla knocks off 'interim' label, names Chris Beard CEO - Computerworld (blog)

Nieuws verzameld via Google - ma, 28/07/2014 - 22:25

Computerworld (blog)

Mozilla knocks off 'interim' label, names Chris Beard CEO
Computerworld (blog)
Before he returned to Mozilla in mid-April to take the interim CEO spot, Beard had been an executive in residence at Greylock Partners, a Menlo Park, Calif. venture capitalist firm. He left Mozilla in June 2013 after serving as its chief marketing ...

Categorieën: Mozilla-nl planet

Mozilla makes interim CEO's job permanent - Engadget

Nieuws verzameld via Google - ma, 28/07/2014 - 22:11

Mozilla makes interim CEO's job permanent
Engadget
Mozilla must've really liked Chris Beard during his time as interim CEO because he is now the real, actual CEO of the company, "interim" prefix not required. Beard took over the reins of the firm in April after former CEO Brendan Eich stepped down ...

Categorieën: Mozilla-nl planet

Mozilla makes interim CEO's job permanent - Engadget

Nieuws verzameld via Google - ma, 28/07/2014 - 21:35

Mozilla makes interim CEO's job permanent
Engadget
Mozilla must've really liked Chris Beard during his time as interim CEO because he is now the real, actual CEO of the company, "interim" prefix not required. Beard took over the reins of the firm in April after former CEO Brendan Eich stepped down ...

Categorieën: Mozilla-nl planet

Interim-ceo Mozilla definitief aangesteld - NUtech

Nieuws verzameld via Google - ma, 28/07/2014 - 21:01

Interim-ceo Mozilla definitief aangesteld
NUtech
Mozilla laat op zijn blog weten dat Beard de beste match uit een selectie van interne en externe kandidaten. Hij werkte van 2004 tot en met halverwege 2013 al voor het bedrijf en is volgens Mozilla bij vrijwel alle aspecten van de organisatie al eens ...
Mozilla benoemt voormalig marketingtopman definitief tot ceoTweakers

alle 2 nieuwsartikelen »
Categorieën: Mozilla-nl planet

Chris Beard Is Mozilla's CEO (Not Just Temporarily) - WebProNews

Nieuws verzameld via Google - ma, 28/07/2014 - 20:56

Chris Beard Is Mozilla's CEO (Not Just Temporarily)
WebProNews
Mozilla announced today that it has appointed Chris Beard as CEO of Mozilla Corp., the for-profit part of Mozilla. They're going with Beard after reviewing “many internal and external candidates”. Beard was appointed interim CEO (as well as to the ...

Categorieën: Mozilla-nl planet

Nachfolger von Brendan Eich: Chris Beard ist neuer Mozilla-Chef - Golem.de

Nieuws verzameld via Google - ma, 28/07/2014 - 20:52

Golem.de

Nachfolger von Brendan Eich: Chris Beard ist neuer Mozilla-Chef
Golem.de
Mozilla hat Chris Beard nach einer Orientierungsphase zum neuen Chef ernannt. Zuvor war er schon Übergangschef und löste den vorherigen Chef Brendan Eich ab, den seine Haltung gegen die Gleichberechtigung homosexueller Paare sein Amt kostete.
Chris Beard ist neuer CEO der Mozilla Corporationsoeren-hentzschel.at
Mozillas Interimschef Chris Beard wird neuer CEOHeise Newsticker

alle 3 nieuwsartikelen »Google Nieuws
Categorieën: Mozilla-nl planet

Mozilla benoemt voormalig marketingtopman definitief tot ceo - Tweakers

Nieuws verzameld via Google - ma, 28/07/2014 - 20:40

Mozilla benoemt voormalig marketingtopman definitief tot ceo
Tweakers
Mozilla heeft maandag Chris Beard, de voormalig chief marketing officer die eerder tijdelijk tot ceo ad interim werd benoemd, definitief aangesteld als ceo. Volgens de organisatie achter de Firefox-webbrowser is Beard de juiste man op de juiste plek.

Categorieën: Mozilla-nl planet

Mozilla benoemt voormalig marketingtopman definitief tot ceo - Tweakers

Nieuws verzameld via Google - ma, 28/07/2014 - 20:40

Mozilla benoemt voormalig marketingtopman definitief tot ceo
Tweakers
Mozilla heeft maandag Chris Beard, de voormalig chief marketing officer die eerder tijdelijk tot ceo ad interim werd benoemd, definitief aangesteld als ceo. Volgens de organisatie achter de Firefox-webbrowser is Beard de juiste man op de juiste plek.
Interim-ceo Mozilla definitief aangesteldNUtech

alle 2 nieuwsartikelen »
Categorieën: Mozilla-nl planet

Mozilla keeps its Beard, hopes anti-gay marriage troubles are now over - Register

Nieuws verzameld via Google - ma, 28/07/2014 - 20:36

Mozilla keeps its Beard, hopes anti-gay marriage troubles are now over
Register
Mozilla has confirmed that Chris Beard, who was appointed as interim CEO three months ago as a replacement for controversial Brendan Eich, will stay at the helm for the foreseeable future. "Chris has a keen sense of where Mozilla has been – and where ...

Categorieën: Mozilla-nl planet

Mozilla names Chris Beard permanent CEO - TechRadar UK

Nieuws verzameld via Google - ma, 28/07/2014 - 20:32

Mozilla names Chris Beard permanent CEO
TechRadar UK
Beard's predecessor, Brendan Eich, was appointed CEO of Mozilla, but quit the post after 11 days, after it was revealed he had made a 2008 donation in support of a ban on gay marriage in California. As a result of Eich's appointment, half of the ...

Categorieën: Mozilla-nl planet

Mozilla confirms interim CEO as new top hire - Ars Technica

Nieuws verzameld via Google - ma, 28/07/2014 - 20:24

Ars Technica

Mozilla confirms interim CEO as new top hire
Ars Technica
On Monday, the Mozilla Corporation announced that its last-minute April hire for interim CEO, Chris Beard, has been permanently appointed to the position. Mozilla Executive Chairwoman Mitchell Baker confirmed the news in a blog post, stating that "the ...

Categorieën: Mozilla-nl planet

Mozilla picks one of its own to be its new CEO - ZDNet

Nieuws verzameld via Google - ma, 28/07/2014 - 19:39

ZDNet

Mozilla picks one of its own to be its new CEO
ZDNet
Beard, who has served as Mozilla's interim CEO since April, had worked as Executive-in-Residence at the venture capital firm Greylock Partners, before returning to Mozilla. In his earlier career Beard had worked at Mozilla since 2004 and the launch of ...
Mozilla Names Interim Chief Permanent CEOWall Street Journal

alle 2 nieuwsartikelen »
Categorieën: Mozilla-nl planet

Mozilla Names Interim Chief Permanent CEO - Wall Street Journal

Nieuws verzameld via Google - ma, 28/07/2014 - 19:24

ZDNet

Mozilla Names Interim Chief Permanent CEO
Wall Street Journal
The maker of the Firefox Web browser, Mozilla Corp., has named Chris Beard as its permanent chief executive, the company said Monday. Mr. Beard, who previously had served as Mozilla's marketing chief, was appointed interim CEO in April after Brendan ...
Mozilla picks one of its own to be its new CEOZDNet
Mozilla keeps its Beard, hopes anti-gay marriage troubles are now overRegister
Chris Beard Is Mozilla's CEO (Not Just Temporarily)WebProNews
Ars Technica -USA TODAY -TechRadar UK
alle 9 nieuwsartikelen »
Categorieën: Mozilla-nl planet

Pagina's