Skip to content

Commit

Permalink
Update LetClauseSparkIterator.java
Browse files Browse the repository at this point in the history
  • Loading branch information
ghislainfourny authored Oct 28, 2024
1 parent 5b892dd commit 3918337
Showing 1 changed file with 2 additions and 6 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -295,12 +295,6 @@ public FlworDataFrame getDataFrameAsJoin(
);
}
}
if (inputTupleValueExpression == null) {
throw new JobWithinAJobException(
"A let clause expression cannot produce a big sequence of items for a big number of tuples, as this would lead to a data flow explosion. We did detect a predicate expression, but the criterion inside the predicate is not comparing the left-hand-side of this predicate to the input tuple.",
getMetadata()
);
}

// Now we know we can execute the query as an equi-join.
// First, we evaluate all input tuples.
Expand Down Expand Up @@ -335,6 +329,8 @@ public FlworDataFrame getDataFrameAsJoin(
sequenceDependencies
).getDataFrame();

LogManager.getLogger("LetClauseSparkIterator").info("Rumble detected an equi-join in the left clause.");

// We compute the hashes for both sides of the equality predicate.
expressionDF = LetClauseSparkIterator.bindLetVariableInDataFrame(
expressionDF,
Expand Down

0 comments on commit 3918337

Please sign in to comment.