Skip to content

Spark ingest tests#1273

Merged
rfecher merged 7 commits intolocationtech:masterfrom
srinivasreddyv2:spark-ingest-tests
Jan 26, 2018
Merged

Spark ingest tests#1273
rfecher merged 7 commits intolocationtech:masterfrom
srinivasreddyv2:spark-ingest-tests

Conversation

@srinivasreddyv2
Copy link
Copy Markdown
Contributor

No description provided.

Signed-off-by: Srinivas Varala <srinivas.varala@gmail.com>
Signed-off-by: Srinivas Varala <srinivas.varala@gmail.com>
Copy link
Copy Markdown
Contributor

@rfecher rfecher left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think these few comments are worth looking at before pulling in.

"^" + namespace),
namespace,
configFile);
null);
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this intentional?

public static final PrimaryIndex DEFAULT_SPATIAL_TEMPORAL_INDEX = new SpatialTemporalDimensionalityTypeProvider()
.createPrimaryIndex();

public static final String S3_INPUT_PATH = "s3://geowave-guide-sv/gdelt";
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

wrong url?

Comment thread core/ingest/pom.xml Outdated
<artifactId>spark-sql_2.11</artifactId>
<version>${spark.version}</version>
</dependency>
<dependency> <!-- Spark dependency -->
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

did anything change that requires this new dependency? I thought spark ingest was already in there and working.

Signed-off-by: Srinivas Varala <srinivas.varala@gmail.com>
Signed-off-by: Srinivas Varala <srinivas.varala@gmail.com>
Signed-off-by: Srinivas Varala <srinivas.varala@gmail.com>
Signed-off-by: Srinivas Varala <srinivas.varala@gmail.com>
Signed-off-by: Srinivas Varala <srinivas.varala@gmail.com>
@rfecher rfecher merged commit 4880557 into locationtech:master Jan 26, 2018
@rfecher rfecher deleted the spark-ingest-tests branch January 26, 2018 20:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants