Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
3 changes: 3 additions & 0 deletions _layouts/global.html
Original file line number Diff line number Diff line change
Expand Up @@ -159,6 +159,9 @@
<div class="container">
<div class="row mt-4">
<div class="col-12 col-md-9">
{% if page.title %}
<h1>{{ page.title }}</h1>
{% endif %}
{{content}}
</div>
<div class="col-12 col-md-3">
Expand Down
3 changes: 0 additions & 3 deletions _layouts/post.html
Original file line number Diff line number Diff line change
@@ -1,9 +1,6 @@
---
layout: global
type: singular
---
<h2>{{page.title}}</h2>


{{content}}

Expand Down
3 changes: 1 addition & 2 deletions committers.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,11 @@
---
layout: global
title: Committers
type: "page singular"
type: "page"
navigation:
weight: 5
show: true
---
<h2>Current committers</h2>

|Name|Organization|
|----|------------|
Expand Down
4 changes: 1 addition & 3 deletions community.md
Original file line number Diff line number Diff line change
@@ -1,14 +1,12 @@
---
layout: global
title: Community
type: "page singular"
type: "page"
navigation:
weight: 5
show: true
---

<h2>Apache Spark<span class="tm">&trade;</span> community</h2>

<a name="have-questions"></a>
<h3>Have questions?</h3>

Expand Down
2 changes: 1 addition & 1 deletion contributing.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
layout: global
title: Contributing to Spark
type: "page singular"
type: "page"
navigation:
weight: 5
show: true
Expand Down
2 changes: 1 addition & 1 deletion developer-tools.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
layout: global
title: Useful Developer Tools
type: "page singular"
type: "page"
navigation:
weight: 5
show: true
Expand Down
5 changes: 1 addition & 4 deletions documentation.md
Original file line number Diff line number Diff line change
@@ -1,14 +1,12 @@
---
layout: global
title: Documentation
type: "page singular"
type: "page"
navigation:
weight: 3
show: true
---

<h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></span> Documentation</h2>

<p>Setup instructions, programming guides, and other documentation are available for each stable version of Spark below:</p>

<ul>
Expand Down Expand Up @@ -251,4 +249,3 @@ Slides, videos and EC2-based exercises from each of these are available online:
Spark was initially developed as a UC Berkeley research project, and much of the design is documented in papers.
The <a href="{{site.baseurl}}/research.html">research page</a> lists some of the original motivation and direction.
</p>

3 changes: 0 additions & 3 deletions downloads.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
---
layout: global
title: Downloads
type: singular
navigation:
weight: 3
show: true
Expand All @@ -16,8 +15,6 @@ window.onload = function () {
}
</script>

## Download Apache Spark&trade;

1. Choose a Spark release:
<select id="sparkVersionSelect" onChange="javascript:onVersionSelect();"></select><br>

Expand Down
6 changes: 2 additions & 4 deletions error-message-guidelines.md
Original file line number Diff line number Diff line change
@@ -1,14 +1,12 @@
---
layout: global
title: Error message guidelines
type: "page singular"
title: Error Message Guidelines
type: "page"
navigation:
weight: 5
show: true
---

## Error Message Guidelines

This guide is a reference for composing standardized and actionable
error messages in Apache Spark.

Expand Down
2 changes: 0 additions & 2 deletions examples.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,10 @@
---
layout: global
title: Examples
type: "page singular"
navigation:
weight: 4
show: true
---
<h1>Apache Spark<span class="tm">&trade;</span> examples</h1>

This page shows you how to use different Apache Spark APIs with simple examples.

Expand Down
3 changes: 1 addition & 2 deletions faq.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,11 @@
---
layout: global
title: FAQ
type: "page singular"
type: "page"
navigation:
weight: 7
show: true
---
<h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></span> FAQ</h2>

<p class="question">How does Spark relate to Apache Hadoop?</p>
<p class="answer">
Expand Down
2 changes: 1 addition & 1 deletion graphx/index.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
layout: global
type: "page singular"
type: "page"
title: GraphX
description: GraphX is Apache Spark's API for graphs and graph-parallel computation, with a built-in library of common algorithms.
subproject: GraphX
Expand Down
4 changes: 1 addition & 3 deletions history.md
Original file line number Diff line number Diff line change
@@ -1,14 +1,12 @@
---
layout: global
title: History
type: "page singular"
type: "page"
navigation:
weight: 5
show: true
---

<h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></span> history</h2>

<p>
Apache Spark started as a research project at the <a href="https://amplab.cs.berkeley.edu">UC Berkeley AMPLab</a>
in 2009, and was open sourced in early 2010.
Expand Down
4 changes: 1 addition & 3 deletions improvement-proposals.md
Original file line number Diff line number Diff line change
@@ -1,14 +1,12 @@
---
layout: global
title: Spark Project Improvement Proposals (SPIP)
type: "page singular"
type: "page"
navigation:
weight: 5
show: true
---

<h2>Spark project improvement proposals (SPIP)</h2>

The purpose of an SPIP is to inform and involve the user community in major improvements to the Spark codebase throughout the development process, to increase the likelihood that user needs are met.

SPIPs should be used for significant user-facing or cross-cutting changes, not small incremental improvements. When in doubt, if a committer thinks a change needs an SPIP, it does.
Expand Down
2 changes: 1 addition & 1 deletion mailing-lists.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
layout: global
title: Mailing Lists
redirect: community.html
type: "page singular"
type: "page"
navigation:
weight: 5
show: true
Expand Down
2 changes: 1 addition & 1 deletion mllib/index.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
layout: global
type: "page singular"
type: "page"
title: MLlib
description: MLlib is Apache Spark's scalable machine learning library, with APIs in Java, Scala, Python, and R.
subproject: MLlib
Expand Down
4 changes: 1 addition & 3 deletions pandas-on-spark/index.md
Original file line number Diff line number Diff line change
@@ -1,13 +1,11 @@
---
layout: global
type: "page singular"
type: "page"
title: pandas API on Spark
description: The pandas API on Spark offers the familiarity of pandas with the power of Spark.
subproject: pandas API on Spark
---

# pandas API on Spark

This page describes the advantages of the pandas API on Spark (“pandas on Spark”) and when you should use it instead of pandas (or in conjunction with pandas).

pandas on Spark can be much faster than pandas and offers syntax that is familiar to pandas users. It offers the power of Spark with the familiarity of pandas.
Expand Down
2 changes: 1 addition & 1 deletion powered-by.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
layout: global
title: Powered By Spark
type: "page singular"
type: "page"
navigation:
weight: 5
show: true
Expand Down
2 changes: 1 addition & 1 deletion release-process.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
layout: global
title: Release Process
type: "page singular"
type: "page"
navigation:
weight: 5
show: true
Expand Down
2 changes: 1 addition & 1 deletion research.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
layout: global
title: Research
type: "page singular"
type: "page"
navigation:
weight: 6
show: true
Expand Down
4 changes: 1 addition & 3 deletions security.md
Original file line number Diff line number Diff line change
@@ -1,14 +1,12 @@
---
layout: global
title: Security
type: "page singular"
type: "page"
navigation:
weight: 5
show: true
---

<h2>Security Model</h2>

For information on what security properties to expect from Apache Spark
and how to configure the various security features, see the
[Spark Security](https://spark.apache.org/docs/latest/security.html)
Expand Down
3 changes: 3 additions & 0 deletions site/404.html
Original file line number Diff line number Diff line change
Expand Up @@ -153,6 +153,9 @@
<div class="container">
<div class="row mt-4">
<div class="col-12 col-md-9">

<h1>404 Not Found</h1>

<h2 id="oops">Oops!</h2>

<p>Sorry, but the page you were trying to view does not exist.</p>
Expand Down
7 changes: 4 additions & 3 deletions site/committers.html
Original file line number Diff line number Diff line change
Expand Up @@ -153,9 +153,10 @@
<div class="container">
<div class="row mt-4">
<div class="col-12 col-md-9">
<h2>Current committers</h2>

<table>

<h1>Committers</h1>

<table>
<thead>
<tr>
<th>Name</th>
Expand Down
7 changes: 4 additions & 3 deletions site/community.html
Original file line number Diff line number Diff line change
Expand Up @@ -153,9 +153,10 @@
<div class="container">
<div class="row mt-4">
<div class="col-12 col-md-9">
<h2>Apache Spark<span class="tm">&trade;</span> community</h2>

<p><a name="have-questions"></a></p>

<h1>Community</h1>

<p><a name="have-questions"></a></p>
<h3>Have questions?</h3>

<h4>StackOverflow</h4>
Expand Down
3 changes: 3 additions & 0 deletions site/contributing.html
Original file line number Diff line number Diff line change
Expand Up @@ -153,6 +153,9 @@
<div class="container">
<div class="row mt-4">
<div class="col-12 col-md-9">

<h1>Contributing to Spark</h1>

<p>This guide documents the best way to make various types of contribution to Apache Spark,
including what is required before submitting a code change.</p>

Expand Down
3 changes: 3 additions & 0 deletions site/developer-tools.html
Original file line number Diff line number Diff line change
Expand Up @@ -153,6 +153,9 @@
<div class="container">
<div class="row mt-4">
<div class="col-12 col-md-9">

<h1>Useful Developer Tools</h1>

<h2>Test coverage</h2>

<p>Apache Spark community uses various resources to maintain the community test coverage.</p>
Expand Down
Loading