Merge from upstream

This still requires some reverts

So
On Thu, 14 Feb 2019, 10:58 Robert Kruszewski<EMAIL_ADDRESS>wrote:

You can view, comment on, or merge this pull request online at:
https://github.com/palantir/spark/pull/490
Commit Summary

[SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF
[SPARK-24687][CORE] Avoid job hanging when generate task binary
causes fatal error
[SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL
[SPARK-26409][SQL][TESTS] SQLConf should be serializable in test
sessions
[SPARK-26392][YARN] Cancel pending allocate requests by taking
locality preference into account
[SPARK-25970][ML] Add Instrumentation to PrefixSpan
[MINOR][SQL] Locality does not need to be implemented
[SPARK-26422][R] Support to disable Hive support in SparkR even for
Hadoop versions unsupported by Hive fork
[SPARK-26267][SS] Retry when detecting incorrect offsets from Kafka
[SPARK-26269][YARN] Yarnallocator should have same blacklist
behaviour with yarn to maxmize use of cluster resource
[SPARK-25642][YARN] Adding two new metrics to record the number of
registered connections as well as the number of active connections to YARN
Shuffle Service
[SPARK-26216][SQL][FOLLOWUP] use abstract class instead of trait for
UserDefinedFunction
[SPARK-26427][BUILD] Upgrade Apache ORC to 1.5.4
[SPARK-26428][SS][TEST] Minimize deprecated ProcessingTime usage
[SPARK-26430][BUILD][TEST-MAVEN] Upgrade Surefire plugin to 3.0.0-M2
[SPARK-26285][CORE] accumulator metrics sources for LongAccumulator
and Doub…
[SPARK-25245][DOCS][SS] Explain regarding limiting modification on
"spark.sql.shuffle.partitions" for structured streaming
[SPARK-26402][SQL] Accessing nested fields with different cases in
case insensitive mode
[SPARK-26178][SPARK-26243][SQL][FOLLOWUP] Replacing SimpleDateFormat
by DateTimeFormatter in comments
[SPARK-14023][CORE][SQL] Don't reference 'field' in StructField
errors for clarity in exceptions
[SPARK-26426][SQL] fix ExpresionInfo assert error in windows
operation system.
[SPARK-26424][SQL] Use java.time API in date/timestamp expressions
[SPARK-26435][SQL] Support creating partitioned table using Hive
CTAS by specifying partition column names
[SPARK-26191][SQL] Control truncation of Spark plans via maxFields
parameter
[SPARK-25892][SQL] Change AttributeReference.withMetadata's return
type to AttributeReference
[SPARK-26451][SQL] Change lead/lag argument name from count to offset
[SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at
ExecutorAllocationManager
[SPARK-26444][WEBUI] Stage color doesn't change with it's status
[SPARK-26424][SQL][FOLLOWUP] Fix DateFormatClass/UnixTime codegen
[SPARK-26496][SS][TEST] Avoid to use Random.nextString in
StreamingInnerJoinSuite
[SPARK-26443][CORE] Use ConfigEntry for hardcoded configs for
history category.
[SPARK-26363][WEBUI] Avoid duplicated KV store lookups in method
taskList
[SPARK-23375][SQL][FOLLOWUP][TEST] Test Sort metrics while Sort is
missing
[SPARK-26504][SQL] Rope-wise dumping of Spark plans
[SPARK-26339][SQL] Throws better exception when reading files that
start with underscore
[SPARK-26495][SQL] Simplify the SelectedField extractor.
[SPARK-26470][CORE] Use ConfigEntry for hardcoded configs for
eventLog category
[MINOR] Fix inconsistency log level among delegation token providers
Revert "[SPARK-26339][SQL] Throws better exception when reading
files that start with underscore"
[SPARK-26499][SQL] JdbcUtils.makeGetter does not handle ByteType
[SPARK-24544][SQL] Print actual failure cause when look up function
failed
[SPARK-25765][ML] Add training cost to BisectingKMeans summary
[SPARK-26374][TEST][SQL] Enable TimestampFormatter in
HadoopFsRelationTest
[SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json]
in R API
[MINOR][R] Deduplicate RStudio setup documentation
[SPARK-26508][CORE][SQL] Address warning messages in Java reported
at lgtm.com
[SPARK-26507][CORE] Fix core tests for Java 11
[SPARK-26277][SQL][TEST] WholeStageCodegen metrics should be tested
with whole-stage codegen enabled
[SPARK-26023][SQL][FOLLOWUP] Dumping truncated plans and generated
code to a file
[SPARK-26403][SQL] Support pivoting using array column for
pivot(column) API
[SPARK-26502][SQL] Move hiveResultString() from QueryExecution to
HiveResult
[SPARK-26501][CORE][TEST] Fix unexpected overriden of exitFn in
SparkSubmitSuite
[SPARK-26517][SQL][TEST] Avoid duplicate test in
ParquetSchemaPruningSuite
[SPARK-26447][SQL] Allow OrcColumnarBatchReader to return less
partition columns
[SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for
python/r categories
[SPARK-26526][SQL][TEST] Fix invalid test case about
non-deterministic expression
[MINOR][NETWORK][TEST] Fix TransportFrameDecoderSuite to use ByteBuf
instead of ByteBuffer
[SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for
driver/executor categories.
[SPARK-26306][TEST][BUILD] More memory to de-flake SorterSuite
[SPARK-24421][CORE][FOLLOWUP] Use normal direct ByteBuffer
allocation if Cleaner can't be set
[SPARK-26537][BUILD] change git-wip-us to gitbox
[SPARK-26536][BUILD][TEST] Upgrade Mockito to 2.23.4
[SPARK-26541][BUILD] Add -Pdocker-integration-tests to
dev/scalastyle
[SPARK-26078][SQL][FOLLOWUP] Remove useless import
[SPARK-26246][SQL][FOLLOWUP] Inferring TimestampType from JSON
[MINOR][DOC] Fix typos in the SQL migration guide
[SPARK-26545] Fix typo in EqualNullSafe's truth table comment
[SPARK-26548][SQL] Don't hold CacheManager write lock while
computing executedPlan
[SPARK-26527][CORE] Let acquireUnrollMemory fail fast if required
space exceeds memory limit
[SPARK-26339][SQL] Throws better exception when reading files that
start with underscore
[SPARK-26547][SQL] Remove duplicate toHiveString from HiveUtils
[SPARK-26554][BUILD] Update release-util.sh to avoid GitBox fake
200 headers
[SPARK-26536][BUILD][FOLLOWUP][TEST-MAVEN] Make StreamingReadSupport
public for maven testing
[MINOR][BUILD] Fix script name in release-tag.sh usage message
[SPARK-26559][ML][PYSPARK] ML image can't work with numpy versions
prior to 1.9
[SPARK-26383][CORE] NPE when use DataFrameReader.jdbc with wrong URL
[SPARK-24489][ML] Check for invalid input type of weight data in
ml.PowerIterationClustering
[SPARK-25689][YARN] Make driver, not AM, manage delegation tokens.
[SPARK-26065][SQL] Change query hint from a LogicalPlan to a field
[SPARK-26491][CORE][TEST] Use ConfigEntry for hardcoded configs for
test categories
[SPARK-26339][SQL][FOLLOW-UP] Issue warning instead of throwing an
exception for underscore files
[MINOR][K8S] add missing docs for podTemplateContainerName properties
[SPARK-26554][BUILD][FOLLOWUP] Use GitHub instead of GitBox to check
HEADER
[SPARK-24196][SQL] Implement Spark's own GetSchemasOperation
[SPARK-26323][SQL] Scala UDF should still check input types even if
some inputs are of type Any
[MINOR][WEBUI] Modify the name of the column named "shuffle spill"
in the StagePage
[SPARK-26002][SQL] Fix day of year calculation for Julian calendar
days
[SPARK-24522][UI] Create filter to apply HTTP security checks
consistently.
[SPARK-24920][CORE] Allow sharing Netty's memory pool allocators
[SPARK-26349][PYSPARK] Forbid insecure py4j gateways
[SPARK-26571][SQL] Update Hive Serde mapping with canonical name of
Parquet and Orc FileFormat
[SPARK-26529] Add debug logs for confArchive when preparing local
resource
[SPARK-26549][PYSPARK] Fix for python worker reuse take no effect
for parallelize lazy iterable range
[SPARK-25484][SQL][TEST] Refactor
ExternalAppendOnlyUnsafeRowArrayBenchmark
[SPARK-26448][SQL] retain the difference between 0.0 and -0.0
[SPARK-26065][FOLLOW-UP][SQL] Fix the Failure when having two
Consecutive Hints
[SPARK-26493][SQL] Allow multiple spark.sql.extensions
[SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter
[SPARK-26491][K8S][FOLLOWUP] Fix compile failure
[SPARK-22128][CORE][BUILD] Add paranamer dependency to core
module
[SPARK-26459][SQL] replace UpdateNullabilityInAttributeReferences
with FixNullability
[SPARK-26539][CORE] Remove spark.memory.useLegacyMode and
StaticMemoryManager
[SPARK-26584][SQL] Remove spark.sql.orc.copyBatchToSpark internal
conf
[SPARK-25921][FOLLOW UP][PYSPARK] Fix barrier task run without
BarrierTaskContext while python worker reuse
[SPARK-26580][SQL] remove Scala 2.11 hack for Scala UDF
[SPARK-26503][CORE] Get rid of spark.sql.legacy.timeParser.enabled
[SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui
categories
[SPARK-26551][SQL] Fix schema pruning error when selecting one
complex field and having is not null predicate on another one
[SPARK-26586][SS] Fix race condition that causes streams to run with
unexpected confs
[SPARK-25692][TEST] Increase timeout in fetchBothChunks test
[SPARK-26482][K8S][TEST][FOLLOWUP] Fix compile failure
[SPARK-26607][SQL][TEST] Remove Spark 2.2.x testing from
HiveExternalCatalogVersionsSuite
[SPARK-26538][SQL] Set default precision and scale for elements of
postgres numeric array
[SPARK-26564] Fix wrong assertions and error messages for parameter
checking
[SPARK-26503][CORE][DOC][FOLLOWUP] Get rid of
spark.sql.legacy.timeParser.enabled
[SPARK-23182][CORE] Allow enabling TCP keep alive on the RPC
connections
[SPARK-26450][SQL] Avoid rebuilding map of schema for every column
in projection
[SPARK-26065][FOLLOW-UP][SQL] Revert hint behavior in join reordering
[SPARK-26576][SQL] Broadcast hint not applied to partitioned table
[SPARK-26456][SQL] Cast date/timestamp to string by
Date/TimestampFormatter
[SPARK-26350][SS] Allow to override group id of the Kafka consumer
[MINOR][BUILD] Remove binary license/notice files in a source
release for branch-2.4+ only
[SPARK-25935][SQL] Allow null rows for bad records from JSON/CSV
parsers
[CORE][MINOR] Fix some typos about MemoryMode
[SPARK-26203][SQL][TEST] Benchmark performance of In and InSet
expressions
[SPARK-26592][SS] Throw exception when kafka delegation token tried
to obtain with proxy user
[SPARK-26462][CORE] Use ConfigEntry for hardcoded configs for
execution categories
[SPARK-25857][CORE] Add developer documentation regarding delegation
tokens.
[SPARK-17928][MESOS] No driver.memoryOverhead setting for mesos
cluster mode
[SPARK-25530][SQL] data source v2 API refactor (batch write)
[SPARK-26350][FOLLOWUP] Add actual verification on new UT introduced
on SPARK-26350
[SPARK-26604][CORE] Clean up channel registration for StreamManager
[SPARK-26615][CORE] Fixing transport server/client resource leaks in
the core unittests
[MINOR][PYTHON] Fix SQLContext to SparkSession in Python API main
page
[SPARK-25992][PYTHON] Document SparkContext cannot be shared for
multiprocessing
[SPARK-26629][SS] Fixed error with multiple file stream in a query +
restart on a batch that has no data for one file stream
[SPARK-26550][SQL] New built-in datasource - noop
[SPARK-26619][SQL] Prune the unused serializers from
SerializeFromObject
[SPARK-26625] Add oauthToken to spark.redaction.regex
[SPARK-26633][REPL] Add ExecutorClassLoader.getResourceAsStream
[SPARK-26600] Update spark-submit usage message
[SPARK-26466][CORE] Use ConfigEntry for hardcoded configs for submit
categories.
[MINOR][BUILD] ensure call to translate_component has correct number
of arguments
[SPARK-26457] Show hadoop configurations in HistoryServer
environment tab
[SPARK-23817][SQL] Create file source V2 framework and migrate ORC
read path
[SPARK-26593][SQL] Use Proleptic Gregorian calendar in casting
UTF8String to Date/TimestampType
[SPARK-26621][CORE] Use ConfigEntry for hardcoded configs for
shuffle categories.
[SPARK-26622][SQL] Revise SQL Metrics labels
[SPARK-26638][PYSPARK][ML] Pyspark vector classes always return
error for unary negation
[SPARK-26640][CORE][ML][SQL][STREAMING][PYSPARK] Code cleanup from
lgtm.com analysis
[SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output
of DataWritingCommandExec
[SPARK-26618][SQL] Make typed Timestamp/Date literals consistent to
casting
[SPARK-26646][TEST][PYSPARK] Fix flaky test:
pyspark.mllib.tests.test_streaming_algorithms
StreamingLogisticRegressionWithSGDTests.test_training_and_prediction
[SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe
category
[MINOR][TEST] Correct some unit test mistakes
[SPARK-26645][PYTHON] Support decimals with negative scale when
parsing datatype
[SPARK-26642][K8S] Add --num-executors option to spark-submit for
Spark on K8S.
[SPARK-26351][MLLIB] Update doc and minor correction in the mllib
evaluation metrics
[SPARK-26652][SQL] Remove fromJSON and fromString from Literal
[SPARK-26676][PYTHON] Make HiveContextSQLTests.test_unbounded_frames
test compatible with Python 2 and PyPy
[SPARK-26520][SQL] data source v2 API refactor (micro-batch read)
[SPARK-25811][PYSPARK] Raise a proper error when unsafe cast is
detected by PyArrow
[SPARK-26616][MLLIB] Expose document frequency in IDFModel
[SPARK-26463][CORE] Use ConfigEntry for hardcoded configs for
scheduler categories.
[SPARK-24938][CORE] Prevent Netty from using onheap memory for
headers without regard for configuration
[SPARK-16838][PYTHON] Add PMML export for ML KMeans in PySpark
[SPARK-26657][SQL] Use Proleptic Gregorian calendar in DayWeek and
in WeekOfYear
[SPARK-26665][CORE] Fix a bug that
BlockTransferService.fetchBlockSync may hang forever
[SPARK-25887][K8S] Configurable K8S context support
[SPARK-26685][K8S] Correct placement of ARG declaration
[SPARK-26661][SQL] Show actual class name of the writing command in
CTAS explain
[MINOR][DOC] Documentation on JVM options for SBT
[SPARK-24484][MLLIB] Power Iteration Clustering is giving incorrect
clustering results when there are mutiple leading eigen values.
[SPARK-26228][MLLIB] OOM issue encountered when computing Gramian
matrix
[SPARK-22465][CORE][FOLLOWUP] Use existing partitioner when
defaultNumPartitions is equal to maxPartitioner.numPartitions
[SPARK-26637][SQL] Makes GetArrayItem nullability more precise
[SPARK-26653][SQL] Use Proleptic Gregorian calendar in parsing JDBC
lower/upper bounds
[SPARK-26681][SQL] Support Ammonite inner-class scopes.
[SPARK-26660] Add warning logs when broadcasting large task binary
[SPARK-26706][SQL] Fix illegalNumericPrecedence for ByteType
[SPARK-25713][SQL] implementing copy for ColumnArray
[SPARK-26617][SQL] Cache manager locks
[SPARK-26682][SQL] Use taskAttemptID instead of attemptNumber for
Hadoop.
[SPARK-26680][SQL] Eagerly create inputVars while conditions are
appropriate
[SPARK-26690] Track query execution and time cost for checkpoints
[SPARK-26687][K8S] Fix handling of custom Dockerfile paths
[SPARK-26530][CORE] Validate heartheat arguments in HeartbeatReceiver
[SPARK-26697][CORE] Log local & remote block sizes.
[SPARK-19591][ML][MLLIB] Add sample weights to decision trees
[MINOR] Add Jenkins and AppVeyor badges at README.md
[SPARK-23674][ML] Adds Spark ML Events to Instrumentation
[SPARK-26709][SQL] OptimizeMetadataOnlyQuery does not handle empty
records correctly
[SPARK-26649][SS] Add DSv2 noop sink
[SPARK-26720][SQL] Remove DateTimeUtils methods based on system
default time zone
[SPARK-26694][CORE] Progress bar should be enabled by default for
spark-shell
[SPARK-26254][CORE] Extract Hive + Kafka dependencies from Core.
[SPARK-22404][YARN] Provide an option to use unmanaged AM in
yarn-client mode
[SPARK-26170][SS] Add missing metrics in FlatMapGroupsWithState
[SPARK-26379][SS] Fix issue on adding current_timestamp/current_date
to streaming query
[SPARK-26711][SQL] Lazily convert string values to BigDecimal during
JSON schema inference
[SPARK-26698][CORE] Use ConfigEntry for hardcoded configs for memory
and storage categories
[SPARK-26630][SQL] Support reading Hive-serde tables whose
INPUTFORMAT is org.apache.hadoop.mapreduce
[SPARK-25981][R] Enables Arrow optimization from R DataFrame to
Spark DataFrame
[SPARK-26735][SQL] Verify plan integrity for special expressions
[SPARK-26379][SS][FOLLOWUP] Use dummy TimeZoneId to avoid
UnresolvedException in CurrentBatchTimestamp
[SPARK-26716][SQL] FileFormat: the supported types of read/write
should be consistent
[SPARK-26708][SQL] Incorrect result caused by inconsistency between
a SQL cache's cached RDD and its physical plan
[SPARK-26743][PYTHON] Adds a test to check the actual resource limit
set via 'spark.executor.pyspark.memory'
[SPARK-26725][TEST] Fix the input values of UnifiedMemoryManager
constructor in test suites
[SPARK-26656][SQL] Benchmarks for date and timestamp functions
[SPARK-26700][CORE] enable fetch-big-block-to-disk by default
[SPARK-26719][SQL] Get rid of java.util.Calendar in DateTimeUtils
[SPARK-26713][CORE] Interrupt pipe IO threads in PipedRDD when task
is finished
[SPARK-26432][CORE] Obtain HBase delegation token operation
compatible with HBase 2.x.x version API
[SPARK-26660][FOLLOWUP] Add warning logs when broadcasting large
task binary
[SPARK-26595][CORE] Allow credential renewal based on kerberos
ticket cache.
[SPARK-26747][SQL] Makes GetMapValue nullability more precise
[SPARK-26566][PYTHON][SQL] Upgrade Apache Arrow to version 0.12.0
[SPARK-26695][SQL] data source v2 API refactor - continuous read
[SPARK-26763][SQL] Using fileStatus cache when filterPartitions
[SPARK-11215][ML] Add multiple columns support to StringIndexer
[SPARK-26702][SQL][TEST] Create a test trait for Parquet and Orc test
[SPARK-26765][SQL] Avro: Validate input and output schema
[SPARK-26718][SS] Fixed integer overflow in SS kafka rateLimit
calculation
[SPARK-26776][PYTHON] Reduce Py4J communication cost in PySpark's
execution barrier check
[SPARK-26378][SQL] Restore performance of queries against wide
CSV/JSON tables
[SPARK-26732][CORE][TEST] Wait for listener bus to process events in
SparkContextInfoSuite.
[SPARK-25689][CORE] Follow up: don't get delegation tokens when
kerberos not available.
[SPARK-26753][CORE] Fixed custom log levels for spark-shell by using
Filter instead of Threshold
[SPARK-26311][CORE] New feature: apply custom log URL pattern for
executor log URLs in SHS
[SPARK-26708][SQL][FOLLOWUP] put the special handling of non-cascade
uncache in the uncache method
[SPARK-24360][SQL] Support Hive 3.1 metastore
[SPARK-26745][SQL] Revert count optimization in JSON datasource by
SPARK-24959
[SPARK-26716][SPARK-26765][FOLLOWUP][SQL] Clean up schema validation
methods and override toString method in Avro
[MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is
dependent on 'resource'
[SPARK-26448][SQL][FOLLOWUP] should not normalize grouping
expressions for final aggregate
[SPARK-24779][R] Add map_concat / map_from_entries / an option in
months_between UDF to disable rounding-off
[SPARK-19591][ML][MLLIB][FOLLOWUP] Add sample weights to decision
trees - fix tolerance
[SPARK-26673][SQL] File source V2 writes: create framework and
migrate ORC
[SPARK-26726] Synchronize the amount of memory used by the broadcast
variable to the UI display
[SPARK-26799][BUILD] Make ANTLR v4 version consistent between Maven
and SBT
[SPARK-26757][GRAPHX] Return 0 for count on empty Edge/Vertex RDDs
[DOC][MINOR] Add metrics instance 'mesos_cluster' to monitoring doc
[SPARK-25997][ML] add Python example code for Power Iteration
Clustering in spark.ml
[SPARK-26787] Fix standardizeLabels error message in
WeightedLeastSquares
[SPARK-7721][INFRA] Run and generate test coverage report from
Python via Jenkins
[SPARK-26730][SQL] Strip redundant AssertNotNull for
ExpressionEncoder's serializer
[SPARK-26525][SHUFFLE] Fast release ShuffleBlockFetcherIterator on
completion of the iteration
Merge branch 'master' into rk/merge-again
Resolve conflicts

File Changes

M .gitignore
https://github.com/palantir/spark/pull/490/files#diff-0 (3)
M FORK.md https://github.com/palantir/spark/pull/490/files#diff-1
(1)
M R/README.md
https://github.com/palantir/spark/pull/490/files#diff-2 (10)
M R/pkg/NAMESPACE
https://github.com/palantir/spark/pull/490/files#diff-3 (7)
M R/pkg/R/DataFrame.R
https://github.com/palantir/spark/pull/490/files#diff-4 (22)
M R/pkg/R/SQLContext.R
https://github.com/palantir/spark/pull/490/files#diff-5 (161)
M R/pkg/R/context.R
https://github.com/palantir/spark/pull/490/files#diff-6 (42)
M R/pkg/R/functions.R
https://github.com/palantir/spark/pull/490/files#diff-7 (205)
M R/pkg/R/generics.R
https://github.com/palantir/spark/pull/490/files#diff-8 (24)
M R/pkg/R/mllib_clustering.R
https://github.com/palantir/spark/pull/490/files#diff-9 (59)
M R/pkg/R/mllib_fpm.R
https://github.com/palantir/spark/pull/490/files#diff-10 (11)
M R/pkg/R/mllib_tree.R
https://github.com/palantir/spark/pull/490/files#diff-11 (6)
M R/pkg/inst/profile/shell.R
https://github.com/palantir/spark/pull/490/files#diff-12 (16)
M R/pkg/tests/fulltests/test_mllib_classification.R
https://github.com/palantir/spark/pull/490/files#diff-13 (6)
M R/pkg/tests/fulltests/test_mllib_clustering.R
https://github.com/palantir/spark/pull/490/files#diff-14 (13)
M R/pkg/tests/fulltests/test_mllib_fpm.R
https://github.com/palantir/spark/pull/490/files#diff-15 (29)
M R/pkg/tests/fulltests/test_mllib_regression.R
https://github.com/palantir/spark/pull/490/files#diff-16 (42)
M R/pkg/tests/fulltests/test_sparkSQL.R
https://github.com/palantir/spark/pull/490/files#diff-17 (113)
M R/pkg/vignettes/sparkr-vignettes.Rmd
https://github.com/palantir/spark/pull/490/files#diff-18 (21)
M README.md
https://github.com/palantir/spark/pull/490/files#diff-19 (4)
M bin/docker-image-tool.sh
https://github.com/palantir/spark/pull/490/files#diff-20 (36)
M
common/network-common/src/main/java/org/apache/spark/network/TransportContext.java
https://github.com/palantir/spark/pull/490/files#diff-21 (9)
M
common/network-common/src/main/java/org/apache/spark/network/client/TransportClientFactory.java
https://github.com/palantir/spark/pull/490/files#diff-22 (11)
M
common/network-common/src/main/java/org/apache/spark/network/protocol/MessageEncoder.java
https://github.com/palantir/spark/pull/490/files#diff-23 (2)
M
common/network-common/src/main/java/org/apache/spark/network/server/ChunkFetchRequestHandler.java
https://github.com/palantir/spark/pull/490/files#diff-24 (1)
M
common/network-common/src/main/java/org/apache/spark/network/server/OneForOneStreamManager.java
https://github.com/palantir/spark/pull/490/files#diff-25 (25)
M
common/network-common/src/main/java/org/apache/spark/network/server/StreamManager.java
https://github.com/palantir/spark/pull/490/files#diff-26 (10)
M
common/network-common/src/main/java/org/apache/spark/network/server/TransportChannelHandler.java
https://github.com/palantir/spark/pull/490/files#diff-27 (18)
M
common/network-common/src/main/java/org/apache/spark/network/server/TransportServer.java
https://github.com/palantir/spark/pull/490/files#diff-28 (26)
M
common/network-common/src/main/java/org/apache/spark/network/util/ByteUnit.java
https://github.com/palantir/spark/pull/490/files#diff-29 (12)
M
common/network-common/src/main/java/org/apache/spark/network/util/NettyUtils.java
https://github.com/palantir/spark/pull/490/files#diff-30 (48)
M
common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java
https://github.com/palantir/spark/pull/490/files#diff-31 (34)
M
common/network-common/src/test/java/org/apache/spark/network/ChunkFetchIntegrationSuite.java
https://github.com/palantir/spark/pull/490/files#diff-32 (2)
M
common/network-common/src/test/java/org/apache/spark/network/ChunkFetchRequestHandlerSuite.java
https://github.com/palantir/spark/pull/490/files#diff-33 (3)
M
common/network-common/src/test/java/org/apache/spark/network/TransportRequestHandlerSuite.java
https://github.com/palantir/spark/pull/490/files#diff-34 (9)
M
common/network-common/src/test/java/org/apache/spark/network/sasl/SparkSaslSuite.java
https://github.com/palantir/spark/pull/490/files#diff-35 (4)
M
common/network-common/src/test/java/org/apache/spark/network/server/OneForOneStreamManagerSuite.java
https://github.com/palantir/spark/pull/490/files#diff-36 (5)
M
common/network-common/src/test/java/org/apache/spark/network/util/TransportFrameDecoderSuite.java
https://github.com/palantir/spark/pull/490/files#diff-37 (3)
M
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockHandler.java
https://github.com/palantir/spark/pull/490/files#diff-38 (26)
M
common/network-shuffle/src/test/java/org/apache/spark/network/shuffle/ExternalShuffleBlockHandlerSuite.java
https://github.com/palantir/spark/pull/490/files#diff-39 (7)
M
common/network-shuffle/src/test/java/org/apache/spark/network/shuffle/OneForOneBlockFetcherSuite.java
https://github.com/palantir/spark/pull/490/files#diff-40 (8)
M
common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java
https://github.com/palantir/spark/pull/490/files#diff-41 (21)
M
common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleServiceMetrics.java
https://github.com/palantir/spark/pull/490/files#diff-42 (5)
M common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java
https://github.com/palantir/spark/pull/490/files#diff-43 (41)
M
common/unsafe/src/main/java/org/apache/spark/unsafe/array/LongArray.java
https://github.com/palantir/spark/pull/490/files#diff-44 (2)
M
common/unsafe/src/main/java/org/apache/spark/unsafe/memory/MemoryLocation.java
https://github.com/palantir/spark/pull/490/files#diff-45 (2)
M
common/unsafe/src/test/java/org/apache/spark/unsafe/PlatformUtilSuite.java
https://github.com/palantir/spark/pull/490/files#diff-46 (18)
M core/pom.xml
https://github.com/palantir/spark/pull/490/files#diff-47 (42)
M core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java
https://github.com/palantir/spark/pull/490/files#diff-48 (6)
M
core/src/main/java/org/apache/spark/shuffle/sort/BypassMergeSortShuffleWriter.java
https://github.com/palantir/spark/pull/490/files#diff-49 (8)
M
core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java
https://github.com/palantir/spark/pull/490/files#diff-50 (15)
M
core/src/main/java/org/apache/spark/shuffle/sort/UnsafeShuffleWriter.java
https://github.com/palantir/spark/pull/490/files#diff-51 (10)
M
core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java
https://github.com/palantir/spark/pull/490/files#diff-52 (174)
M
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/PrefixComparators.java
https://github.com/palantir/spark/pull/490/files#diff-53 (2)
M
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java
https://github.com/palantir/spark/pull/490/files#diff-54 (14)
M
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeSorterSpillReader.java
https://github.com/palantir/spark/pull/490/files#diff-55 (35)
A
core/src/main/resources/META-INF/services/org.apache.spark.deploy.security.HadoopDelegationTokenProvider
https://github.com/palantir/spark/pull/490/files#diff-56 (2)
M
core/src/main/resources/org/apache/spark/ui/static/executorspage.js
https://github.com/palantir/spark/pull/490/files#diff-57 (3)
M core/src/main/resources/org/apache/spark/ui/static/historypage.js
https://github.com/palantir/spark/pull/490/files#diff-58 (16)
M
core/src/main/resources/org/apache/spark/ui/static/spark-dag-viz.js
https://github.com/palantir/spark/pull/490/files#diff-59 (8)
M core/src/main/resources/org/apache/spark/ui/static/stagepage.js
https://github.com/palantir/spark/pull/490/files#diff-60 (32)
M
core/src/main/resources/org/apache/spark/ui/static/stagespage-template.html
https://github.com/palantir/spark/pull/490/files#diff-61 (8)
M core/src/main/resources/org/apache/spark/ui/static/table.js
https://github.com/palantir/spark/pull/490/files#diff-62 (2)
M
core/src/main/resources/org/apache/spark/ui/static/timeline-view.css
https://github.com/palantir/spark/pull/490/files#diff-63 (8)
M core/src/main/resources/org/apache/spark/ui/static/utils.js
https://github.com/palantir/spark/pull/490/files#diff-64 (6)
M core/src/main/resources/org/apache/spark/ui/static/webui.js
https://github.com/palantir/spark/pull/490/files#diff-65 (3)
M core/src/main/scala/org/apache/spark/ContextCleaner.scala
https://github.com/palantir/spark/pull/490/files#diff-66 (11)
M core/src/main/scala/org/apache/spark/Dependency.scala
https://github.com/palantir/spark/pull/490/files#diff-67 (6)
M
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala
https://github.com/palantir/spark/pull/490/files#diff-68 (53)
M core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala
https://github.com/palantir/spark/pull/490/files#diff-69 (27)
M core/src/main/scala/org/apache/spark/Heartbeater.scala
https://github.com/palantir/spark/pull/490/files#diff-70 (11)
M core/src/main/scala/org/apache/spark/MapOutputTracker.scala
https://github.com/palantir/spark/pull/490/files#diff-71 (13)
M core/src/main/scala/org/apache/spark/Partitioner.scala
https://github.com/palantir/spark/pull/490/files#diff-72 (8)
M core/src/main/scala/org/apache/spark/SecurityManager.scala
https://github.com/palantir/spark/pull/490/files#diff-73 (109)
M core/src/main/scala/org/apache/spark/SparkConf.scala
https://github.com/palantir/spark/pull/490/files#diff-74 (106)
M core/src/main/scala/org/apache/spark/SparkContext.scala
https://github.com/palantir/spark/pull/490/files#diff-75 (104)
M core/src/main/scala/org/apache/spark/SparkEnv.scala
https://github.com/palantir/spark/pull/490/files#diff-76 (46)
M
core/src/main/scala/org/apache/spark/api/java/JavaSparkContext.scala
https://github.com/palantir/spark/pull/490/files#diff-77 (4)
M core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala
https://github.com/palantir/spark/pull/490/files#diff-78 (32)
M
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala
https://github.com/palantir/spark/pull/490/files#diff-79 (12)
M
core/src/main/scala/org/apache/spark/api/python/PythonWorkerFactory.scala
https://github.com/palantir/spark/pull/490/files#diff-80 (15)
M core/src/main/scala/org/apache/spark/api/r/RBackend.scala
https://github.com/palantir/spark/pull/490/files#diff-81 (10)
M core/src/main/scala/org/apache/spark/api/r/RBackendHandler.scala
https://github.com/palantir/spark/pull/490/files#diff-82 (7)
M core/src/main/scala/org/apache/spark/api/r/RRunner.scala
https://github.com/palantir/spark/pull/490/files#diff-83 (21)
M core/src/main/scala/org/apache/spark/api/r/RUtils.scala
https://github.com/palantir/spark/pull/490/files#diff-84 (3)
M
core/src/main/scala/org/apache/spark/broadcast/TorrentBroadcast.scala
https://github.com/palantir/spark/pull/490/files#diff-85 (12)
M core/src/main/scala/org/apache/spark/deploy/Client.scala
https://github.com/palantir/spark/pull/490/files#diff-86 (13)
M core/src/main/scala/org/apache/spark/deploy/Common.scala
https://github.com/palantir/spark/pull/490/files#diff-87 (6)
M
core/src/main/scala/org/apache/spark/deploy/ExternalShuffleService.scala
https://github.com/palantir/spark/pull/490/files#diff-88 (2)
M
core/src/main/scala/org/apache/spark/deploy/FaultToleranceTest.scala
https://github.com/palantir/spark/pull/490/files#diff-89 (12)
M
core/src/main/scala/org/apache/spark/deploy/LocalSparkCluster.scala
https://github.com/palantir/spark/pull/490/files#diff-90 (4)
M core/src/main/scala/org/apache/spark/deploy/PythonRunner.scala
https://github.com/palantir/spark/pull/490/files#diff-91 (4)
M core/src/main/scala/org/apache/spark/deploy/RRunner.scala
https://github.com/palantir/spark/pull/490/files#diff-92 (25)
M
core/src/main/scala/org/apache/spark/deploy/SparkCuratorUtil.scala
https://github.com/palantir/spark/pull/490/files#diff-93 (3)
M core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala
https://github.com/palantir/spark/pull/490/files#diff-94 (11)
M core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
https://github.com/palantir/spark/pull/490/files#diff-95 (93)
M
core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala
https://github.com/palantir/spark/pull/490/files#diff-96 (48)
M
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala
https://github.com/palantir/spark/pull/490/files#diff-97 (92)
A
core/src/main/scala/org/apache/spark/deploy/history/HistoryAppStatusStore.scala
https://github.com/palantir/spark/pull/490/files#diff-98 (133)
M
core/src/main/scala/org/apache/spark/deploy/history/HistoryPage.scala
https://github.com/palantir/spark/pull/490/files#diff-99 (5)
M
core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala
https://github.com/palantir/spark/pull/490/files#diff-100 (34)
M
core/src/main/scala/org/apache/spark/deploy/history/HistoryServerArguments.scala
https://github.com/palantir/spark/pull/490/files#diff-101 (2)
M core/src/main/scala/org/apache/spark/deploy/master/Master.scala
https://github.com/palantir/spark/pull/490/files#diff-102 (58)
M
core/src/main/scala/org/apache/spark/deploy/master/MasterArguments.scala
https://github.com/palantir/spark/pull/490/files#diff-103 (5)
M
core/src/main/scala/org/apache/spark/deploy/master/RecoveryModeFactory.scala
https://github.com/palantir/spark/pull/490/files#diff-104 (7)
M
core/src/main/scala/org/apache/spark/deploy/master/ZooKeeperLeaderElectionAgent.scala
https://github.com/palantir/spark/pull/490/files#diff-105 (5)
M
core/src/main/scala/org/apache/spark/deploy/master/ZooKeeperPersistenceEngine.scala
https://github.com/palantir/spark/pull/490/files#diff-106 (15)
M
core/src/main/scala/org/apache/spark/deploy/master/ui/ApplicationPage.scala
https://github.com/palantir/spark/pull/490/files#diff-107 (3)
M
core/src/main/scala/org/apache/spark/deploy/master/ui/MasterPage.scala
https://github.com/palantir/spark/pull/490/files#diff-108 (6)
M
core/src/main/scala/org/apache/spark/deploy/master/ui/MasterWebUI.scala
https://github.com/palantir/spark/pull/490/files#diff-109 (3)
M
core/src/main/scala/org/apache/spark/deploy/rest/StandaloneRestServer.scala
https://github.com/palantir/spark/pull/490/files#diff-110 (15)
M
core/src/main/scala/org/apache/spark/deploy/rest/SubmitRestProtocolRequest.scala
https://github.com/palantir/spark/pull/490/files#diff-111 (11)
M
core/src/main/scala/org/apache/spark/deploy/security/HBaseDelegationTokenProvider.scala
https://github.com/palantir/spark/pull/490/files#diff-112 (60)
M
core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenManager.scala
https://github.com/palantir/spark/pull/490/files#diff-113 (187)
M
core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenProvider.scala
https://github.com/palantir/spark/pull/490/files#diff-114 (3)
M
core/src/main/scala/org/apache/spark/deploy/security/HadoopFSDelegationTokenProvider.scala
https://github.com/palantir/spark/pull/490/files#diff-115 (81)
A core/src/main/scala/org/apache/spark/deploy/security/README.md
https://github.com/palantir/spark/pull/490/files#diff-116 (249)
M
core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala
https://github.com/palantir/spark/pull/490/files#diff-117 (6)
M
core/src/main/scala/org/apache/spark/deploy/worker/DriverWrapper.scala
https://github.com/palantir/spark/pull/490/files#diff-118 (6)
M
core/src/main/scala/org/apache/spark/deploy/worker/ExecutorRunner.scala
https://github.com/palantir/spark/pull/490/files#diff-119 (3)
M core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala
https://github.com/palantir/spark/pull/490/files#diff-120 (29)
M
core/src/main/scala/org/apache/spark/deploy/worker/WorkerArguments.scala
https://github.com/palantir/spark/pull/490/files#diff-121 (5)
M
core/src/main/scala/org/apache/spark/deploy/worker/ui/LogPage.scala
https://github.com/palantir/spark/pull/490/files#diff-122 (28)
M
core/src/main/scala/org/apache/spark/deploy/worker/ui/WorkerWebUI.scala
https://github.com/palantir/spark/pull/490/files#diff-123 (3)
M
core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala
https://github.com/palantir/spark/pull/490/files#diff-124 (9)
M core/src/main/scala/org/apache/spark/executor/Executor.scala
https://github.com/palantir/spark/pull/490/files#diff-125 (16)
M
core/src/main/scala/org/apache/spark/executor/ExecutorMetrics.scala
https://github.com/palantir/spark/pull/490/files#diff-126 (23)
A
core/src/main/scala/org/apache/spark/executor/ProcfsMetricsGetter.scala
https://github.com/palantir/spark/pull/490/files#diff-127 (228)
M core/src/main/scala/org/apache/spark/executor/TaskMetrics.scala
https://github.com/palantir/spark/pull/490/files#diff-128 (3)
M core/src/main/scala/org/apache/spark/internal/Logging.scala
https://github.com/palantir/spark/pull/490/files#diff-129 (49)
A core/src/main/scala/org/apache/spark/internal/config/Deploy.scala
https://github.com/palantir/spark/pull/490/files#diff-130 (68)
M
core/src/main/scala/org/apache/spark/internal/config/History.scala
https://github.com/palantir/spark/pull/490/files#diff-131 (66)
A core/src/main/scala/org/apache/spark/internal/config/Kafka.scala
https://github.com/palantir/spark/pull/490/files#diff-132 (91)
A core/src/main/scala/org/apache/spark/internal/config/Kryo.scala
https://github.com/palantir/spark/pull/490/files#diff-133 (57)
A
core/src/main/scala/org/apache/spark/internal/config/Network.scala
https://github.com/palantir/spark/pull/490/files#diff-134 (93)
A core/src/main/scala/org/apache/spark/internal/config/Python.scala
https://github.com/palantir/spark/pull/490/files#diff-135 (47)
A core/src/main/scala/org/apache/spark/internal/config/R.scala
https://github.com/palantir/spark/pull/490/files#diff-136 (40)
A core/src/main/scala/org/apache/spark/internal/config/Tests.scala
https://github.com/palantir/spark/pull/490/files#diff-137 (56)
A core/src/main/scala/org/apache/spark/internal/config/UI.scala
https://github.com/palantir/spark/pull/490/files#diff-138 (145)
A core/src/main/scala/org/apache/spark/internal/config/Worker.scala
https://github.com/palantir/spark/pull/490/files#diff-139 (63)
M
core/src/main/scala/org/apache/spark/internal/config/package.scala
https://github.com/palantir/spark/pull/490/files#diff-140 (669)
M core/src/main/scala/org/apache/spark/io/CompressionCodec.scala
https://github.com/palantir/spark/pull/490/files#diff-141 (25)
M core/src/main/scala/org/apache/spark/memory/MemoryManager.scala
https://github.com/palantir/spark/pull/490/files#diff-142 (4)
D
core/src/main/scala/org/apache/spark/memory/StaticMemoryManager.scala
https://github.com/palantir/spark/pull/490/files#diff-143 (145)
M
core/src/main/scala/org/apache/spark/memory/UnifiedMemoryManager.scala
https://github.com/palantir/spark/pull/490/files#diff-144 (22)
M core/src/main/scala/org/apache/spark/memory/package.scala
https://github.com/palantir/spark/pull/490/files#diff-145 (9)
M
core/src/main/scala/org/apache/spark/metrics/ExecutorMetricType.scala
https://github.com/palantir/spark/pull/490/files#diff-146 (74)
M core/src/main/scala/org/apache/spark/metrics/MetricsConfig.scala
https://github.com/palantir/spark/pull/490/files#diff-147 (3)
M core/src/main/scala/org/apache/spark/metrics/MetricsSystem.scala
https://github.com/palantir/spark/pull/490/files#diff-148 (10)
M
core/src/main/scala/org/apache/spark/metrics/sink/MetricsServlet.scala
https://github.com/palantir/spark/pull/490/files#diff-149 (2)
A
core/src/main/scala/org/apache/spark/metrics/source/AccumulatorSource.scala
https://github.com/palantir/spark/pull/490/files#diff-150 (89)
M
core/src/main/scala/org/apache/spark/network/BlockTransferService.scala
https://github.com/palantir/spark/pull/490/files#diff-151 (12)
M
core/src/main/scala/org/apache/spark/network/netty/NettyBlockRpcServer.scala
https://github.com/palantir/spark/pull/490/files#diff-152 (3)
M
core/src/main/scala/org/apache/spark/network/netty/SparkTransportConf.scala
https://github.com/palantir/spark/pull/490/files#diff-153 (25)
M core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala
https://github.com/palantir/spark/pull/490/files#diff-154 (3)
M core/src/main/scala/org/apache/spark/rdd/PipedRDD.scala
https://github.com/palantir/spark/pull/490/files#diff-155 (33)
M core/src/main/scala/org/apache/spark/rdd/RDD.scala
https://github.com/palantir/spark/pull/490/files#diff-156 (8)
M
core/src/main/scala/org/apache/spark/rdd/ReliableCheckpointRDD.scala
https://github.com/palantir/spark/pull/490/files#diff-157 (10)
M
core/src/main/scala/org/apache/spark/rdd/ReliableRDDCheckpointData.scala
https://github.com/palantir/spark/pull/490/files#diff-158 (3)
M core/src/main/scala/org/apache/spark/rdd/UnionRDD.scala
https://github.com/palantir/spark/pull/490/files#diff-159 (3)
M core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala
https://github.com/palantir/spark/pull/490/files#diff-160 (5)
M core/src/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala
https://github.com/palantir/spark/pull/490/files#diff-161 (7)
M
core/src/main/scala/org/apache/spark/scheduler/BarrierJobAllocationFailed.scala
https://github.com/palantir/spark/pull/490/files#diff-162 (3)
M
core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala
https://github.com/palantir/spark/pull/490/files#diff-163 (6)
M core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
https://github.com/palantir/spark/pull/490/files#diff-164 (11)
M
core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala
https://github.com/palantir/spark/pull/490/files#diff-165 (2)
M
core/src/main/scala/org/apache/spark/scheduler/ReplayListenerBus.scala
https://github.com/palantir/spark/pull/490/files#diff-166 (2)
M
core/src/main/scala/org/apache/spark/scheduler/SchedulableBuilder.scala
https://github.com/palantir/spark/pull/490/files#diff-167 (10)
M
core/src/main/scala/org/apache/spark/scheduler/SchedulerBackend.scala
https://github.com/palantir/spark/pull/490/files#diff-168 (7)
M
core/src/main/scala/org/apache/spark/scheduler/ShuffleMapTask.scala
https://github.com/palantir/spark/pull/490/files#diff-169 (20)
M
core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala
https://github.com/palantir/spark/pull/490/files#diff-170 (3)
M
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala
https://github.com/palantir/spark/pull/490/files#diff-171 (13)
M
core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala
https://github.com/palantir/spark/pull/490/files#diff-172 (34)
M
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedClusterMessage.scala
https://github.com/palantir/spark/pull/490/files#diff-173 (6)
M
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
https://github.com/palantir/spark/pull/490/files#diff-174 (90)
M
core/src/main/scala/org/apache/spark/scheduler/cluster/ExecutorData.scala
https://github.com/palantir/spark/pull/490/files#diff-175 (5)
M
core/src/main/scala/org/apache/spark/scheduler/cluster/ExecutorInfo.scala
https://github.com/palantir/spark/pull/490/files#diff-176 (12)
M
core/src/main/scala/org/apache/spark/scheduler/cluster/StandaloneSchedulerBackend.scala
https://github.com/palantir/spark/pull/490/files#diff-177 (24)
M
core/src/main/scala/org/apache/spark/scheduler/local/LocalSchedulerBackend.scala
https://github.com/palantir/spark/pull/490/files#diff-178 (7)
M
core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala
https://github.com/palantir/spark/pull/490/files#diff-179 (5)
M
core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala
https://github.com/palantir/spark/pull/490/files#diff-180 (31)
M
core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala
https://github.com/palantir/spark/pull/490/files#diff-181 (9)
M
core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala
https://github.com/palantir/spark/pull/490/files#diff-182 (8)
A
core/src/main/scala/org/apache/spark/shuffle/ShuffleWriteProcessor.scala
https://github.com/palantir/spark/pull/490/files#diff-183 (74)
M
core/src/main/scala/org/apache/spark/shuffle/sort/SortShuffleManager.scala
https://github.com/palantir/spark/pull/490/files#diff-184 (4)
M
core/src/main/scala/org/apache/spark/shuffle/sort/SortShuffleWriter.scala
https://github.com/palantir/spark/pull/490/files#diff-185 (4)
M
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala
https://github.com/palantir/spark/pull/490/files#diff-186 (80)
M core/src/main/scala/org/apache/spark/status/AppStatusStore.scala
https://github.com/palantir/spark/pull/490/files#diff-187 (132)
M core/src/main/scala/org/apache/spark/status/LiveEntity.scala
https://github.com/palantir/spark/pull/490/files#diff-188 (9)
M
core/src/main/scala/org/apache/spark/status/api/v1/StagesResource.scala
https://github.com/palantir/spark/pull/490/files#diff-189 (1)
M core/src/main/scala/org/apache/spark/status/api/v1/api.scala
https://github.com/palantir/spark/pull/490/files#diff-190 (10)
M core/src/main/scala/org/apache/spark/status/storeTypes.scala
https://github.com/palantir/spark/pull/490/files#diff-191 (3)
M core/src/main/scala/org/apache/spark/storage/BlockManager.scala
https://github.com/palantir/spark/pull/490/files#diff-192 (60)
M
core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
https://github.com/palantir/spark/pull/490/files#diff-193 (6)
M
core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala
https://github.com/palantir/spark/pull/490/files#diff-194 (4)
M core/src/main/scala/org/apache/spark/storage/DiskStore.scala
https://github.com/palantir/spark/pull/490/files#diff-195 (2)
M
core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala
https://github.com/palantir/spark/pull/490/files#diff-196 (62)
M core/src/main/scala/org/apache/spark/storage/TopologyMapper.scala
https://github.com/palantir/spark/pull/490/files#diff-197 (4)
M
core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala
https://github.com/palantir/spark/pull/490/files#diff-198 (6)
M core/src/main/scala/org/apache/spark/ui/ConsoleProgressBar.scala
https://github.com/palantir/spark/pull/490/files#diff-199 (4)
A core/src/main/scala/org/apache/spark/ui/HttpSecurityFilter.scala
https://github.com/palantir/spark/pull/490/files#diff-200 (116)
M core/src/main/scala/org/apache/spark/ui/JettyUtils.scala
https://github.com/palantir/spark/pull/490/files#diff-201 (156)
M core/src/main/scala/org/apache/spark/ui/SparkUI.scala
https://github.com/palantir/spark/pull/490/files#diff-202 (6)
M core/src/main/scala/org/apache/spark/ui/UIUtils.scala
https://github.com/palantir/spark/pull/490/files#diff-203 (21)
M core/src/main/scala/org/apache/spark/ui/UIWorkloadGenerator.scala
https://github.com/palantir/spark/pull/490/files#diff-204 (5)
M core/src/main/scala/org/apache/spark/ui/WebUI.scala
https://github.com/palantir/spark/pull/490/files#diff-205 (15)
M core/src/main/scala/org/apache/spark/ui/env/EnvironmentPage.scala
https://github.com/palantir/spark/pull/490/files#diff-206 (21)
M
core/src/main/scala/org/apache/spark/ui/exec/ExecutorThreadDumpPage.scala
https://github.com/palantir/spark/pull/490/files#diff-207 (4)
M core/src/main/scala/org/apache/spark/ui/exec/ExecutorsTab.scala
https://github.com/palantir/spark/pull/490/files#diff-208 (3)
M core/src/main/scala/org/apache/spark/ui/jobs/AllJobsPage.scala
https://github.com/palantir/spark/pull/490/files#diff-209 (19)
M core/src/main/scala/org/apache/spark/ui/jobs/JobPage.scala
https://github.com/palantir/spark/pull/490/files#diff-210 (19)
M core/src/main/scala/org/apache/spark/ui/jobs/JobsTab.scala
https://github.com/palantir/spark/pull/490/files#diff-211 (7)
M core/src/main/scala/org/apache/spark/ui/jobs/PoolPage.scala
https://github.com/palantir/spark/pull/490/files#diff-212 (3)
M core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala
https://github.com/palantir/spark/pull/490/files#diff-213 (30)
M core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala
https://github.com/palantir/spark/pull/490/files#diff-214 (15)
M core/src/main/scala/org/apache/spark/ui/jobs/StagesTab.scala
https://github.com/palantir/spark/pull/490/files#diff-215 (7)
M core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala
https://github.com/palantir/spark/pull/490/files#diff-216 (11)
M core/src/main/scala/org/apache/spark/util/JsonProtocol.scala
https://github.com/palantir/spark/pull/490/files#diff-217 (38)
M core/src/main/scala/org/apache/spark/util/RpcUtils.scala
https://github.com/palantir/spark/pull/490/files#diff-218 (18)
M core/src/main/scala/org/apache/spark/util/SizeEstimator.scala
https://github.com/palantir/spark/pull/490/files#diff-219 (5)
M core/src/main/scala/org/apache/spark/util/Utils.scala
https://github.com/palantir/spark/pull/490/files#diff-220 (101)
M
core/src/main/scala/org/apache/spark/util/collection/ExternalAppendOnlyMap.scala
https://github.com/palantir/spark/pull/490/files#diff-221 (7)
M
core/src/main/scala/org/apache/spark/util/collection/ExternalSorter.scala
https://github.com/palantir/spark/pull/490/files#diff-222 (6)
M
core/src/main/scala/org/apache/spark/util/collection/Spillable.scala
https://github.com/palantir/spark/pull/490/files#diff-223 (2)
M
core/src/main/scala/org/apache/spark/util/io/ChunkedByteBuffer.scala
https://github.com/palantir/spark/pull/490/files#diff-224 (2)
M
core/src/main/scala/org/apache/spark/util/logging/FileAppender.scala
https://github.com/palantir/spark/pull/490/files#diff-225 (10)
M
core/src/main/scala/org/apache/spark/util/logging/RollingFileAppender.scala
https://github.com/palantir/spark/pull/490/files#diff-226 (19)
M
core/src/test/java/org/apache/spark/launcher/SparkLauncherSuite.java
https://github.com/palantir/spark/pull/490/files#diff-227 (102)
M
core/src/test/java/org/apache/spark/memory/TaskMemoryManagerSuite.java
https://github.com/palantir/spark/pull/490/files#diff-228 (25)
M
core/src/test/java/org/apache/spark/memory/TestMemoryConsumer.java
https://github.com/palantir/spark/pull/490/files#diff-229 (4)
M
core/src/test/java/org/apache/spark/shuffle/sort/PackedRecordPointerSuite.java
https://github.com/palantir/spark/pull/490/files#diff-230 (7)
M
core/src/test/java/org/apache/spark/shuffle/sort/ShuffleInMemorySorterSuite.java
https://github.com/palantir/spark/pull/490/files#diff-231 (5)
M
core/src/test/java/org/apache/spark/shuffle/sort/UnsafeShuffleWriterSuite.java
https://github.com/palantir/spark/pull/490/files#diff-232 (18)
M
core/src/test/java/org/apache/spark/unsafe/map/AbstractBytesToBytesMapSuite.java
https://github.com/palantir/spark/pull/490/files#diff-233 (77)
M
core/src/test/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorterSuite.java
https://github.com/palantir/spark/pull/490/files#diff-234 (4)
M
core/src/test/java/org/apache/spark/util/collection/unsafe/sort/UnsafeInMemorySorterSuite.java
https://github.com/palantir/spark/pull/490/files#diff-235 (9)
M
core/src/test/resources/HistoryServerExpectations/app_environment_expectation.json
https://github.com/palantir/spark/pull/490/files#diff-236 (5)
M
core/src/test/resources/HistoryServerExpectations/application_list_json_expectation.json
https://github.com/palantir/spark/pull/490/files#diff-237 (15)
M
core/src/test/resources/HistoryServerExpectations/completed_app_list_json_expectation.json
https://github.com/palantir/spark/pull/490/files#diff-238 (15)
M
core/src/test/resources/HistoryServerExpectations/executor_list_json_expectation.json
https://github.com/palantir/spark/pull/490/files#diff-239 (3)
M
core/src/test/resources/HistoryServerExpectations/executor_list_with_executor_metrics_json_expectation.json
https://github.com/palantir/spark/pull/490/files#diff-240 (64)
A
core/src/test/resources/HistoryServerExpectations/executor_list_with_executor_process_tree_metrics_json_expectation.json
https://github.com/palantir/spark/pull/490/files#diff-241 (100)
M
core/src/test/resources/HistoryServerExpectations/executor_memory_usage_expectation.json
https://github.com/palantir/spark/pull/490/files#diff-242 (15)
M
core/src/test/resources/HistoryServerExpectations/executor_node_blacklisting_expectation.json
https://github.com/palantir/spark/pull/490/files#diff-243 (15)
M
core/src/test/resources/HistoryServerExpectations/executor_node_blacklisting_unblacklisting_expectation.json
https://github.com/palantir/spark/pull/490/files#diff-244 (15)
M
core/src/test/resources/HistoryServerExpectations/limit_app_list_json_expectation.json
https://github.com/palantir/spark/pull/490/files#diff-245 (30)
M
core/src/test/resources/HistoryServerExpectations/minDate_app_list_json_expectation.json
https://github.com/palantir/spark/pull/490/files#diff-246 (15)
M
core/src/test/resources/HistoryServerExpectations/minEndDate_app_list_json_expectation.json
https://github.com/palantir/spark/pull/490/files#diff-247 (15)
A
core/src/test/resources/META-INF/services/org.apache.spark.deploy.security.HadoopDelegationTokenProvider
https://github.com/palantir/spark/pull/490/files#diff-248 (1)
A core/src/test/resources/ProcfsMetrics/22763/stat
https://github.com/palantir/spark/pull/490/files#diff-249 (1)
A core/src/test/resources/ProcfsMetrics/26109/stat
https://github.com/palantir/spark/pull/490/files#diff-250 (1)
M core/src/test/resources/spark-events/app-20161116163331-0000
https://github.com/palantir/spark/pull/490/files#diff-251 (2)
A
core/src/test/resources/spark-events/application_1538416563558_0014
https://github.com/palantir/spark/pull/490/files#diff-252 (190)
M
core/src/test/scala/org/apache/spark/BarrierStageOnSubmittedSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-253 (30)
M core/src/test/scala/org/apache/spark/CheckpointSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-254 (8)
M core/src/test/scala/org/apache/spark/ContextCleanerSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-255 (115)
M core/src/test/scala/org/apache/spark/DistributedSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-256 (15)
M
core/src/test/scala/org/apache/spark/ExecutorAllocationManagerSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-257 (77)
M
core/src/test/scala/org/apache/spark/ExternalShuffleServiceSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-258 (6)
M core/src/test/scala/org/apache/spark/FailureSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-259 (3)
M core/src/test/scala/org/apache/spark/FileSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-260 (19)
M core/src/test/scala/org/apache/spark/HeartbeatReceiverSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-261 (20)
M core/src/test/scala/org/apache/spark/JobCancellationSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-262 (26)
M core/src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-263 (22)
M core/src/test/scala/org/apache/spark/SecurityManagerSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-264 (281)
M core/src/test/scala/org/apache/spark/ShuffleSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-265 (18)
M core/src/test/scala/org/apache/spark/SortShuffleSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-266 (3)
M core/src/test/scala/org/apache/spark/SparkConfSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-267 (59)
M core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-268 (1)
M
core/src/test/scala/org/apache/spark/SparkContextSchedulerCreationSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-269 (103)
M core/src/test/scala/org/apache/spark/SparkContextSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-270 (341)
M core/src/test/scala/org/apache/spark/SparkFunSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-271 (15)
M
core/src/test/scala/org/apache/spark/api/python/PythonBroadcastSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-272 (8)
M
core/src/test/scala/org/apache/spark/broadcast/BroadcastSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-273 (12)
M
core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-274 (628)
M
core/src/test/scala/org/apache/spark/deploy/StandaloneDynamicAllocationSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-275 (18)
M
core/src/test/scala/org/apache/spark/deploy/client/AppClientSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-276 (75)
M
core/src/test/scala/org/apache/spark/deploy/history/ApplicationCacheSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-277 (2)
M
core/src/test/scala/org/apache/spark/deploy/history/FsHistoryProviderSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-278 (375)
M
core/src/test/scala/org/apache/spark/deploy/history/HistoryServerArgumentsSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-279 (23)
M
core/src/test/scala/org/apache/spark/deploy/history/HistoryServerDiskManagerSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-280 (6)
M
core/src/test/scala/org/apache/spark/deploy/history/HistoryServerSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-281 (33)
M
core/src/test/scala/org/apache/spark/deploy/master/MasterSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-282 (135)
M
core/src/test/scala/org/apache/spark/deploy/master/PersistenceEngineSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-283 (8)
M
core/src/test/scala/org/apache/spark/deploy/rest/SubmitRestProtocolSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-284 (3)
M
core/src/test/scala/org/apache/spark/deploy/security/HadoopDelegationTokenManagerSuite.scala
https://github.com/palantir/spark/pull/490/files#diff-285 (103)
M
core/src/test/scala/org/apache/spark/d

This should be gtg


Add a very basic "text editor" widget, a copy of integer widget allowing any text

Is this meant for text literals and Text type?

Is this meant for text literals and Text type?

Yes, for faster typing of arguments such as column names.


support for subpacket 33

Parse, interpret and test subpacket 33, which is IssuerFingerprint

r? @oconnor663

used in an error printf


Enforce 100% I18n coverage from now on

https://trello.com/c/BhRV4Sqy/1679-increase-our-i18n-coverage-to-100
This add an extra step in our internal I18n coverage checker, which will
return a non-zero (error) exit code if the coverage is below 100%. While
this will be the case when running specific tests, it won't interfere with
the test runner e.g.
 Finished in 0.56256 seconds (files took 6.93 seconds to load)
 1 example, 0 failures

 Coverage report generated for I18n to /govuk/content-publisher/coverage/i18n. 7 / 648 keys (1.08%) covered.
 I18n coverage (1.08%) is below the expected minimum coverage (100%)
 I18nCov failed with exit 1
 Coverage report generated for RSpec to /govuk/content-publisher/coverage. 296 / 528 LOC (56.06%) covered.
 SimpleCov failed with exit

Please see the commits for more details.

@ChrisBAshton thanks for taking a look. That's an interesting idea. Personally I don't find the coverage outputs annoying. For example, we always get the following when a spec fails
Coverage report generated for RSpec to /govuk/content-publisher/coverage. 47 / 137 LOC (34.31%) covered.
SimpleCov failed with exit 1

If we were to turn on SimpleCov minimum coverage, we'd get a similar response. (I forgot to mention that I was making them consistent.)
Coverage report generated for I18n to /govuk/content-publisher/coverage/i18n. 14 / 650 keys (2.15%) covered.
Coverage report generated for RSpec to /govuk/content-publisher/coverage. 182 / 356 LOC (51.12%) covered.
Line coverage (51.12%) is below the expected minimum coverage (100.00%).
SimpleCov failed with exit 2

It looks like this is a non-trivial problem to solve, and I'm cautious about moving coverage checking away, as I can imagine it breaking without anyone noticing. As a compromise, I've tried one of the suggestions in the issue. How does it look now?


Issues with newer versions of python and wxpython :: attrdict module

We had some users doing a fresh install get an error with wxpython through the grids requirements
Collecting wxpython
  Using cached wxPython-4.2.0.tar.gz (71.0 MB)
  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [8 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/private/var/folders/64/jv4mfhbd2_x1_cjtgz_lv0z00000gn/T/pip-install-m9dtaqfn/wxpython_be9e764dd24e4871932935e5b5d1a760/setup.py", line 27, in <module>
          from buildtools.config import Config, msg, opj, runcmd, canGetSOName, getSOName
        File "/private/var/folders/64/jv4mfhbd2_x1_cjtgz_lv0z00000gn/T/pip-install-m9dtaqfn/wxpython_be9e764dd24e4871932935e5b5d1a760/buildtools/config.py", line 30, in <module>
          from attrdict import AttrDict
      ModuleNotFoundError: No module named 'attrdict'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Some additional digging (https://github.com/wxWidgets/Phoenix/issues/2225) indicates this might be a problem with wxpython=4.2
Possible fix: change wxpython to be either less than or greater than 4.2

I can confirm that no one in TerraPower uses a version of wxPython greater than 4.1.1.
At least it's an easy fix.

Thanks for the report Drew! Maybe try pip install attrdict3 and re-run? It might work. Seems related to this: https://github.com/wxWidgets/Phoenix/issues/2225

@drewj-usnctech I see some traffic that people were working on this.  Has it been resolved for you?
It appears to be a very version-dependent problem, between Python and the wxPython library.

@john-science sorry, I've been out on PTO for the last two weeks.
That traffic is not related to us and it hasn't been resolved. We've still been telling people to manually force a lower version of wxpython when installing armi grids

@drewj-usnctech Okay, I am going to change our setup.py and requirements files to enforce that version limit on wxpython. Assuming they use pip, it should automate that process.
We are hopefully replacing this GUI soon with a Jupyter-based one.  So, hopefully this is very temporary.

thanks @john-science! Looking forward to it


support_set

is:issue is:open 请问作者能否公开一下support_set？

Thanks for your interest in our project! Regarding the support set, it is designed in accordance with the RegAD setting .

陈樱文收到，谢谢


Hermite polynomials

Hello,
Does it exist a finite-element space that ensures the continuity of the solution and its derivative? Like the Hermite polynomials ?
Best,
Leïla

Yes, there are C1 elements that are in H2, i.e. have both continuous values and continuous derivatives.
These however are not currently supported in MFEM.


rr: disable LTO and build with current stdenv

Description of changes
On current nixpkgs master, rr is not building (hydra log). Using gcc 11 fixes that, but suffers from the same linking problem as in #110846. To work around that, I disabled LTO.
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

Are you willing to report this upstream as well to get it fixed?

I am, but I don't know if I'll have enough time in the near future to investigate. Since other distributions don't hit this, the most likely explanation is that this is a bug with some Nix gcc/binutils wrapper.

Aww ok, that does indeed complicate things.


Is there a way to use to_string with struct names

When using the ron::ser::to_string() function, the struct names option for the Serializer is set to false. Is there a way to run the same function but with struct names set to true? Since the output field of the Serializer struct is private, I was unable to rewrite the function in my own crate.

You can use ron::ser::to_string_pretty(value, ron::ser::PrettyConfig::new().struct_names(true))

I was looking for this but it wasn't in v1.7.0. I see this has been added recently. Thanks.

I'm glad I could help you :)


[ParameterValidator] Handle missing parameter type

If the 'type' property for a required parameter is not specified it was treated as if it was not required by getQueriedContext since 434c126.
Maybe there's some more readable way to write this but this seems to make it work as intended at least!

You are right, the current condition is wrong if the type is not specified. It actually took me a while to understand how the condition works (which is funny because I wrote it myself... not a good sign).
Your condition is correct though.

Maybe there's some more readable way to write this but this seems to make it work as intended at least!

Indeed. One way this can be simplified is by putting in a guard clause like this (haven't tested it):
// Check if all parameters of the context are satisfied
foreach($set as $id => $properties) {
    if(isset($data[$id]) && !empty($data[$id])) {
        $queriedContexts[$context] = true;
    } elseif (isset($properties['type']
    && ($properties['type'] === 'checkbox' || $properties['type'] === 'list'))) {
        continue;
    } elseif(isset($properties['required']) && $properties['required'] === true) {
        $queriedContexts[$context] = false;
        break;
    }
}

The second elseif checks if the type is set and any of the not supported types, in which case the remaining loop is skipped. That should make it easier to understand imo. What do you think?

Forgot a bit about this for a while, but yes that looks much better to me! I added a commit with the suggested changes.

Looks good to me ! Thanks for the PR !


linked config setting not working as expected?

Affected Packages
pkg:cli
Problem
I was assuming linked would help with enforcing packages to always use the same version amongst each other, similar to how Lerna does. However that appears to not be the case. Here's the recent versioning pull request on Slate that shows the issue: https://github.com/ianstormtaylor/slate/pull/4198
Both slate and slate-react are bumped to 0.62.1 but the others are left at 0.62.0.
Proposed solution
Either change linked to keep things at the same version, or potentially add another setting called pinned or something that does it. The use case being keeping a set of packages always on the same version when one of them is bumped so that people can be guaranteed to have packages that work together really easily. (I believe this is what popular projects like Babel and React do?)

@Andarist any insight around this? I was hoping we could rely on "linked": [["*"]] to link every package within the monorepo together similar to how Lerna would work using lerna version --force-publish

Agreed that this would be useful — changesets looks awesome and I'd love to migrate Apollo Server from lerna to it, but we depend on being able to publish all of our "entry point" packages (apollo-server-express, apollo-server-lambda, etc) at the same version so we can talk about v3.1.2 of Apollo Server in a simple way.

@ianstormtaylor Not sure I'm understanding this correctly, but I stumbled upon this issue because I believe I had the same problem. I'm maintaining @use-gesture with the following package structure 👍
@use-gesture/core
@use-gesture/react
@use-gesture/vanilla

I wanted both @use-gesture/react and @use-gesture/vanilla to be strictly dependent on @use-gesture/core versioning, but it seemed that patching @use-gesture/core wouldn't update neither of them.
I realized that in my package.json files for both react and vanilla package, I had:
"dependencies": {
  "@use-gesture/core": "^10.0.0"
}

... instead of:
"dependencies": {
  "@use-gesture/core": "10.0.0"
}

Moving to a strict versioning made it work as expected (ie patching core resulted in all packages to bump versions).
Hope it helps and sorry if this is unrelated.

The fixed mode is being implemented in https://github.com/changesets/changesets/pull/690 . Please check out if it matches your expectations

Very cool, though my project might just manage to migrate to a single-package release instead of a monorepo :)


Intelligent Smart Contracts for Innovative Supply Chain Management

NOTE: All 1st-time contributors should know Topic approval and PR submission does NOT guarantee your Topic/Article will be published. Our team of Peer Reviewers and Content Moderators will review all PRs that come in to make sure they adhere to the standard of quality we expect from the EngEd community.
We expect all community memebers to go through provided examples, resources, and previously published material before submitting content. As a rule of thumb, please only submit articles (pull requests) that are complete, formatted correctly, and include a fully polished article (ready to be published and error free).
All revisions and edits should be completed on your own forked repo (as to not take up room in the queue). Any PR that is submitted incomplete (meaning not ready to be published as is) will be closed. A PR being closed does NOT mean the article can not be published (or fixed) it simply means that the edits, revisions, and fixes will happen outside of the queue.
NOTE: Any topic suggestion copied/taken/modified from YouTube may Lead to a permanent ban from the community.
Topic Suggestion
Enter topic suggestion here...
Pre-submission advice
By following all our pre-submission advice and reviewing our Resources folder, you will maximise your chances of your topic being approved.
We ask that you please be patient as our team works through approving and publishing all articles/tutorials in a timely manner.
Allow 1-3 days for a topic to be reviewed and/or approved - allow 3-7 days for an articles to be reviewed and/or published (subject to vary depending on volume and/or backlog of articles).
Be sure to visit our Resources Page for tools, resources, and example articles that will help you propose and write a successful article.
Please ensure that you have only one open issue + linked pull request at a time. This will ensure that we complete the article in a timely manner from inception to publishing.)
We tend to stray away or tend not to publish reviews/comparisons of commercial product offerings.
Writing sample(s):
Include any links or writing samples - to help our team better gauge your writing quality.
Proposal Submission
Proposed title of article
Intelligent Smart Contracts for Innovative Supply Chain Management
Use keyword research to improve your article's SEO.
Proposed article introduction
Innovative supply chain management is a topic that is constantly growing in interest as the world becomes more connected. One of the key ways to improve supply chain management is by developing smart contracts which are an integral part of blockchain technology. The best part is that you don’t have to be a genius developer to create a smart contract. In this article, I will be discussing the basics of smart contracts and how they can be used to improve supply chain management.
For example, if the article is based on machine learning, use the following: [Machine learning] Introduction to Machine Learning.
If the article is based on developing an Android application, use the following: [Android] Developing Apps using Android.
ONLY viable topics to pick from:

API
Artificial Intelligence
Blockchain
Containers
Edge Computing
Languages
Machine Learning
Networking
Node.js
Security

Key takeaways

Definition of intelligent smart contract.
Create custom blockchain for the smart contract.
How to create intelligent smart contract .
implementation of smart contracts in the innovative supply chain management.
How can smart contracts improve supply chain management.

Article quality
How is your article unique? Tell us what makes your approach different from similar articles that have published on the same topic?
Is yours more in-depth? Does it cover additional topics? Do you provide handy tips or anecdotal advice?
References
Please list links to any published content/research that you intend to use to support/guide this article.
Conclusion
Finally, remove the Pre-Submission advice section and all our blockquoted notes as you fill in the form before you submit.
We look forwarding to reviewing your topic suggestion.
Templates to use as guides

How To Guide Template
Software Review Template
Tutorial Template

Good afternoon and thank you for submitting your topic to the EngEd program.
After some careful consideration, it struck us that this topic may be a bit over-saturated throughout other blog sites and official documentations.
We typically refrain from publishing content that is covered widely on the net or other blogs. We're more interested in original, practitioner-focused content that takes a deeper dive into programming-centric concepts.
But in order to approve the topic, it has to serve value to the larger developer community at large.
An option and a great way to write this as an in-depth article and make it more add value to the greater developer community at large would be to walk the reader through the USE of methods and functions by building a unique, different, useful project.

We would love to learn your thought process behind the solution you arrived at using these concepts and topics.

That way a developer could see them in action.
As mentioned above - we believe this topic is widely covered on other blog sites.
The best way for students to build a great portfolio is by building what does not exist and what can provide the most value.


Adding content to Win forensics and other tools; Adding sections for OSX forensics,Sandboxing/reversing and Books

Added misc information I have found useful
-Highlighter from Fire/Mandiant
-RegRipper Registry tool for win forensics
-OSX Evidence Section
-Sandboxing/reversing tools (both local and online)
-Etherpad For document collaboration
-Kibana for Big data visualization
-Elastic Search for Big Data searching (think log analysis)
-Book Section with Amazon link (feel free to change)

Very nice additions!!
For next time try to open a PR for each addition, that way we can merge some of them (in case we are not sure about the others...)


Remove triple-quotes from single-line Turtle strings

A triple-quoted string allows RDF string literals to span multiple
lines.  However, a single-line string does not require a triple-quoted
string.  The rdf-toolkit utility that UCO uses to normalize its ontology
definition files will remove such superfluous triple-quote characters.
To simplify using rdf-toolkit in patch review, this patch applies all
triple-quote simplifications that rdf-toolkit suggested when run against
the current head of the develop branch.  One other trailing whitespace
line was added to observable.ttl.  No other changes were made.
These changes have been confirmed, using the framework in the CASE
Examples QC repository, to match the output of rdf-toolkit.
https://github.com/ajnelson-nist/CASE-Examples-QC/
This commit resolves UCO Issue 96:
https://github.com/ucoProject/UCO/issues/96
Signed-off-by: Alex Nelson<EMAIL_ADDRESS>

I've updated this branch against the current state of develop, checked its diff, and believe it's ready for merging.  There appears to be no change, as the already-merged commit 6abab6d duplicates this branch's contribution.
If the committee would like the extra git-log message on triple quotes to be integrated into UCO's Git history, then this branch should be merged.  Otherwise, the PR can be closed without merging.


Update how-to-convert-between-various-string-types.md

fix typo

@drvoss : Thanks for your contribution! The author, @, has been notified to review your proposed change.


[BUG] FigureResampler show_dash in JupyterLab fails to display plot

Describe the bug :crayon:

A clear and concise description of what the bug is.

Plotly-resampler figureresampler fails to load dash figures in a jupyterhub+jupyterlab on kubernetes (i.e. z2jh) environment. With jupyterhub on kubernetes, user notebook servers are spawned as pods and user access to those servers are proxied via jupyterhub.
Dash requires requests_pathname_prefix on init() and jupyter_server_url on run for it to display inline or provide correct link for external display. show_dash_kwargs is only passed to dash on run() and not init() so end result is it doesn't work.
Reproducing the bug :mag:

Please provide steps & minimal viable code to reproduce the behavior.
Giving this information makes it tremendously easier to work on your issue!

Snippet taken from plotly_resampler_basic_example.ipynb, main difference is adding extra dash kwargs for it to work in jupyterhub+jupyterlab on kubernetes behind jupyterhub proxy.
import pandas as pd
import numpy as np
import plotly.graph_objects as go
from plotly.subplots import make_subplots

import sys

# BEGIN Additional portion for jupyterhub
import os
import plotly.io as pio
pio.renderers.default = 'iframe' # or 'colab' or 'iframe' or 'iframe_connected' or 'sphinx_gallery'
port = 7004
service_prefix = os.getenv('JUPYTERHUB_SERVICE_PREFIX', '/')
domain = os.getenv('JUPYTERHUB_HTTP_REFERER', "https://<my jupyterhub domain>")
requests_pathname_prefix=f"{service_prefix}proxy/{port}/"
show_dash_kwargs={"requests_pathname_prefix":requests_pathname_prefix}
# END additional portion for jupyterhub

sys.path.append("..")
from plotly_resampler import FigureResampler, FigureWidgetResampler, EveryNthPoint
from plotly_resampler.aggregation import NoGapHandler, MedDiffGapHandler

n = 2_000_000
x = np.arange(n)
noisy_sine = (3 + np.sin(x / 2000) + np.random.randn(n) / 10) * x / (n / 4)
fig = FigureResampler(go.Figure(),show_dash_kwargs=show_dash_kwargs)
fig.add_trace(go.Scattergl(showlegend=True), hf_x=x, hf_y=noisy_sine, max_n_samples=300)
fig.add_trace(dict(x=x, y=noisy_sine + 1, name='sp1'), max_n_samples=2000)
fig.show_dash(mode="inline",jupyter_server_url=domain,port=port)

Expected behavior  :wrench:

Please give a clear and concise description of what you expected to happen.

Ability to pass kwargs to dash.Dash() init() and run() so that plot can display correctly in 'inline' or 'external' modes.
See workaround section for suggestion.
Screenshots  :camera_flash:

If applicable, add screenshots to help explain your problem.

Without workaround

With workaround/suggested solution

Environment information: (please complete the following information)

OS: Rocky Linux release 8.8 (Green Obsidian) kernel 5.14.0-284.30.1.el9_2.x86_64
Python environment:

Python version: 3.11.6
plotly-resampler environment: JupyterLab, tested with Chrome/Edge but problem should be browser agnostic

plotly-resampler version: 0.9.1

# pip3 freeze |egrep -i "jupy|dash|plotly"
dash==2.14.0
dash-core-components==2.0.0
dash-html-components==2.0.0
dash-table==5.0.0
jupyter_client==8.4.0
jupyter_core==5.4.0
jupyterlab-widgets==3.0.9
jupytext==1.15.2
plotly==5.17.0 #have also tried with 5.18.0
plotly-resampler==0.9.1

Workaround / Solution
Allow passing through kwargs to dash init.
Replace app = dash.Dash("local_app") with app = dash.Dash("local_app",**self._show_dash_kwargs) in plotly_resampler/figure_resampler/figure_resampler.py
Example one liner sed to do code replacement
sed -i 's/app = dash.Dash("local_app")/app = dash.Dash("local_app",**self._show_dash_kwargs)/g' ..../plotly_resampler/figure_resampler/figure_resampler.py

Might be cleaner to have a dash_kwargs in addition to show_dash kwargs though.
Additional context
Side note, I can't get other modes to work

figureresampler + inline_persistent -> I don't have jupyter-dash installed since dash 2.11+ natively supports jupyterlab (expected)
figurewidgetresampler + any mode -> get a javascript error indicating it fails to load model class from jupyter-plotly

Hi @miloaissatu,
First and foremost, thank you so much for providing a highly detailed description of this issue! 🤝
I suppose, as how you've described this issue, that by adding the "show_dash_kwargs" and "init_dash_kwargs" variables to the show_dash method of the FigureResampler, this issue can be overcome? I added this to my backlog and aim to tackle this issue in a new branch which I will reference here somewhere this week, I'll keep you posted!
However, as I do not have a K8s jupyterhub test setup (and I guess it will take me quite some time to get this set up), I would highly appreciate it if you could aid me in providing (i) some documentation and/or (ii) an "JupyterHubFigureResampler" subclass for this environment.
Kind regards,
Jonas

"'JupyterHubFigureResampler' subclass for this environment." I'm not quite sure what this entails, could you elaborate? :)
in terms of documentation, went and did abit more digging and these are relevant

brief mention of steps to use dash/jupyterdash in jupyterhub on kubernetes in this specific comment , the rest of the issue thread isn't too relevant. The jupyterdash project example notebook also has these steps https://github.com/plotly/jupyter-dash/blob/a18b3d2b29d34f0673938be956d85bac0a38c20f/notebooks/getting_started.ipynb
Looking into how jupyterdash (used to) handles it. The note on the jupyterdash project says functionality has been merged into dash 2.11 but i don't see an equivalent of this behaviour (probably because dash doesn't need the front end plugin + jupyter lab build setup which involves some nodejs build/recompilation.)

jupyterdash has infer_jupyter_proxy_config -> _request_jupyter_config that sends base_url_request.

I believe its able to get the base_url where the client session is accessing the jupyter env/notebook from through its paired jupyterlab-dash frontend plugin, and that its otherwise not possible purely from a backend/python perspective since that all looks like localhost.

It then sets JupyterDash.default_requests_pathname_prefix to base_url +'/proxy/{port}/' and uses it in its init and run methods, similar to dash.Dash.

sidenote - now that i dig in to it, looks like there is an env var i could have set to achieve the same result: https://github.com/plotly/jupyter-dash/blob/a18b3d2b29d34f0673938be956d85bac0a38c20f/jupyter_dash/jupyter_app.py#L50

by doing this its able to resolve to the correct url for the client to display the plot/app
a note on the jupyterdash page says dash 2.11 has this functionality natively, looks like its here. I haven't tried this natively. They've also updated this page since i've last looked at it. I suspect that it might still need jupyterlab-dash frontend plugin, i tried without the plugin in my env and got an error


Importing styles from a component in a parent directory fails

I'm in a situation where in one repository, I have a Preact app. Then, in a directory several directories higher, I have a shared component directory. I'm able to import the component fine, but the styles object is empty.
If I move that component into the same directory, the styles import works as expected.
// header.js
import styles from './styles';
console.log({ styles });

// App.js
import Header from '../../../shared/header';
// Result log: styles empty object

// App.js
import Header from './header';
// Result log: styles with class properties

Is this a known/expected limitation? Should I be importing them in a different way?

Hello - this is an issue with preact-cli, not Preact. The behavior described is expected - CSS modules is only enabled within the src/components directory, so if you import CSS from outside that directory it is treated as "global" (non-modular) CSS that has no exports.
Please open an issue on the preact-cli repo if you need some more help.


Check for 403 response for every request

Great tool! The fastest I've tried for directory bruting.
One request I'd like to make is a check for every response returning a 403. I've seen other tools do is if almost every response is a 403, then they quit with a warning instead of going through the entire wordlist.

Thanks for your kind words! Do you think that it would be important enough to add a new command line flag for it?
I think there are many actual use cases where the user would want to keep hammering the service, for fuzzing some authentication headers for example. Because of this I'd like to keep the default as it is currently.

The standard for most tools is to default to not following a 403, and having a flag to do so. I'd definitely love to see  this as a feature / agree with having it as a flag.


Kariba graphic illustrations

@ciciaran do you mind linking to the work product here so I can take a look? In general would be helpful for closing out any issues. Thanks!

Google drive folder here  @ryscheng


Fix require.config issue

What kind of change does this PR introduce?
bugfix
Did you add tests for your changes?
Fixed tests to expect "corrected" value
If relevant, link to documentation update:
N/A
Summary
As discovered by @Kovensky  in #3846 there is an issue in evaluating the require.config()/requirejs.config() call. This is his proposed fix.
Does this PR introduce a breaking change?
No
Other Information
this PR relies on

[ ] #3846

to be merged

This PR is in a weird state...

ill close this in favour of #3846 changes are incorporated there


Setting repo timeout

I'm running 0.4.2 Docker image on SQLite.
When I update my repo's timeout I can see a PATCH request in browser console log. The response is 200 but its payload holds the old timeout value and the slider is still showing my new value.
Since the issue's not been reported before I suspect it has something to do w/ SQLite storage.
And here's how my docker-compose.yml looks like:
version: '2'
services:
  drone-server:
    image: drone/drone:0.4.2
    container_name: "drone"
    ports:
      - "8000:8000"
    volumes:
      - drone:/var/lib/drone/
      - /var/run/docker.sock:/var/run/docker.sock
    environment:
      DATABASE_DRIVER: sqlite3
      DATABASE_CONFIG: /var/lib/drone/drone.sqlite
      REMOTE_DRIVER: github
      REMOTE_CONFIG: "https://github.com?client_id=…&client_secret=…&open=true&orgs=…"

volumes:
  drone:

Only the drone admin can update the timeout value. Feel free to use gitter.im/drone/drone for support questions. Thanks!


Get Failed to find Element even though element id exists.

Code to reproduce error.
Cargo.toml
[dependencies]
reqwest = { version = "*", features = ["blocking", "json"] }
tl = { version = "*", features = ["simd"] }

main.rs
use std::{
    fs::File,
    io::{self, BufRead, BufReader, Write},
    path::Path,
};
use tl::{ VDom, Parser};

fn get_block(id: &str, parser: &Parser, dom: &VDom) {
    println!("id is: {}", id);
    let element = dom.get_element_by_id(id)
        .expect("Failed to find element")
        .get(parser)
        .unwrap();
    println!("Inner HTML: {:?}", element.inner_html());
    println!("Inner TEXT: {:?}", element.inner_text(parser));
}

fn main() -> Result<(), Box<dyn std::error::Error>> {
    let resp = reqwest::blocking::get("https://www.thefreespeechforum.com")?.text()?;
    let mut html_file = File::create("tfsf_offline.html")?;
    html_file.write(resp.as_bytes())?;

    let dom = tl::parse(resp.as_str(), tl::ParserOptions::default());
    let parser = dom.parser();

    get_block("u54423", &parser, &dom);
    get_block("u54389-4", &parser, &dom);

    Ok(())
}

The second get_block works as expected.  But the first one fails to find the element, even though I have manually confirmed that the id does exist.  It is also not a problem with finding a id's because the second get_block call is also is also an a id.
Screenshot showing that the id does actually exist.

Thanks for the report!
Reduced test case that fails:
let input = r#"

"#;

let dom = parse(input, ParserOptions::default());
let element = dom.get_element_by_id("u54423");

assert!(element.is_some());

Looks like the allowfullscreen valueless attribute of the inner iframe tag causes a silent error, which in turn causes its parent tag to not be in the DOM tree.

Wow, thanks for the quick response!  Unfortunately I don't have the option of changing the html.  Where might I start looking to attempt to fix the bug.  If I can get a good fix I can submit a pull request, if you don't beat me to it :smile:

Indeed the bug is in Parser::parse_attributes (in particular line 197):
https://github.com/y21/tl/blob/fa3fd1c6986c6e94ac9b1735fad34a8409a17ded/src/parser/base.rs#L197
It always advances the cursor after every attribute to skip quotes (i.e. the last " in ). Then, on the next iteration, it skips unnecessary whitespaces and checks if the current character (which in this case would be >), is one of ['/', '>']. If it is, it returns from parse_attributes with all matches as it's done parsing the attributes.
However, when there is no quote (or no value at all), this gets buggy. For example, given , the function would skip the > as it wrongly assumes that the current character is a quote. This is bad, because now it interprets the rest of the string as more attributes.
One way to fix this would be to only advance the input stream if the character is not >.
if self.stream.current_cpy() != Some(b'>') {
  self.stream.advance();
}

Would you like to try to fix this in a PR or do you want me to?
Also, while looking through the code, I found another bug (unquoted attribute values not being parsed properly), but I'd like to fix that in a separate PR because that's a bit more complex.

I'll get started on the pull request as it would be a good chance for me to one contribute and two to get more familiar with your crate!  That would free you up to tackle the more complex PR.  If I finish this one, I'd love to collaborate with you on the next PR, if I wouldn't get in your way.

I'll get started on the pull request as it would be a good chance for me to one contribute and two to get more familiar with your crate!

Sounds good :)

If I finish this one, I'd love to collaborate with you on the next PR, if I wouldn't get in your way.

Sure, I opened a separate issue for tracking this: #12. It's actually not as complex as I made it sound like, but it means creating (or changing an existing method) and some additions involving SIMD (Parser::read_to needs to search for more than one byte).


jhi-item-count Does not change language

Overview of the issue

The jhi-item-count component does not change the language after the user select other than the default.
Motivation for or Use Case

The translation is in the global.json file, so, it should work.
Reproduce the error

Create a project with two languages (English and spanish in my case)
Go to some entity page and change language
The interface changes but no the component

Related issues

Not that I am aware of
Suggest a Fix

From what I see the span is taking the text from the tag body and not from the $t function, if I chage the
v-bind:html="$t('global.item-count')"

to
v-text="$t('global.item-count')"

Then the label is loaded, but the place holders are not replaced for the actual values.
JHipster Version(s)

v6.3.1
JHipster configuration

v6.3.1
JHipster configuration
INFO! Using JHipster version installed locally in current project's node_modules
INFO! Executing jhipster:info
INFO! Options: from-cli: true
Welcome to the JHipster Information Sub-Generator
JHipster Version(s)
<EMAIL_ADDRESS>/home/antonio/Projects/Carwash/project3/carwash
└─┬<EMAIL_ADDRESS>  └──<EMAIL_ADDRESS>

JHipster configuration, a .yo-rc.json file generated in the root folder

.yo-rc.json file

{
  "generator-jhipster": {
    "databaseType": "sql",
    "devDatabaseType": "postgresql",
    "enableHibernateCache": true,
    "enableSwaggerCodegen": false,
    "enableTranslation": true,
    "jhiPrefix": "bjt",
    "languages": ["en", "es"],
    "messageBroker": false,
    "nativeLanguage": "en",
    "packageName": "com.bejoto.carwash",
    "packageFolder": "com/bejoto/carwash",
    "prodDatabaseType": "postgresql",
    "searchEngine": "elasticsearch",
    "serviceDiscoveryType": false,
    "skipClient": false,
    "skipServer": false,
    "testFrameworks": [],
    "websocket": false,
    "baseName": "carwash",
    "buildTool": "gradle",
    "clientFramework": "vuejs",
    "jhipsterVersion": "6.3.1",
    "skipUserManagement": false,
    "clientPackageManager": "npm",
    "applicationType": "monolith",
    "authenticationType": "jwt",
    "cacheProvider": "ehcache",
    "clientTheme": "none",
    "clientThemeVariant": "",
    "serverPort": "8080",
    "useSass": true,
    "jwtSecretKey": "xxx",
    "embeddableLaunchScript": false,
    "entitySuffix": "",
    "dtoSuffix": "DTO",
    "otherModules": [
      {
        "name": "generator-jhipster-vuejs",
        "version": "1.1.0"
      }
    ],
    "blueprints": [
      {
        "name": "generator-jhipster-vuejs",
        "version": "1.1.0"
      }
    ]
  },
  "entities": [
    "VehicleType",
    "VehicleColor",
    "VehicleBrand",
    "Vehicle",
    "Product",
    "ServiceForSale",
    "Client",
    "Sale",
    "SaleProductRecord",
    "SaleServiceForSaleRecord",
    "SaleLog"
  ],
  "generator-jhipster-vuejs": {
    "jhipsterVersion": "6.1.2",
    "applicationType": "monolith",
    "baseName": "carwash",
    "useSass": true,
    "enableTranslation": true,
    "clientPackageManager": "npm",
    "clientFramework": "vuejs",
    "clientTheme": "none",
    "clientThemeVariant": "",
    "languages": ["en", "es"]
  }
}

JDL for the Entity configuration(s) entityName.json files generated in the .jhipster directory

JDL entity definitions

entity VehicleType {
  name String required minlength(1) maxlength(500),
  enabled Boolean required
}
entity VehicleColor {
  name String required minlength(1) maxlength(500),
  hexColor String required minlength(6) maxlength(6),
  enabled Boolean required
}
entity VehicleBrand {
  name String required minlength(1) maxlength(500),
  enabled Boolean required
}
entity Vehicle {
  plate String required minlength(1) maxlength(500),
  created Instant required,
  lastUpdate Instant required
}
entity Product {
  name String required minlength(1) maxlength(500),
  code String required minlength(1) maxlength(500),
  price BigDecimal required min(0),
  existence Integer required min(0),
  enabled Boolean required,
  created Instant required,
  lastUpdate Instant required
}
entity ServiceForSale {
  name String required minlength(1) maxlength(500),
  code String required minlength(1) maxlength(500),
  price BigDecimal required min(0),
  enabled Boolean required,
  created Instant required,
  lastUpdate Instant required
}
entity Client {
  name String required minlength(1) maxlength(500),
  email String minlength(1) maxlength(500),
  mobile String minlength(1) maxlength(500),
  enabled Boolean required,
  created Instant required,
  lastUpdate Instant required
}
entity Sale {
  clientName String minlength(1) maxlength(500),
  vehicleDescription String minlength(1) maxlength(500),
  total BigDecimal required min(0),
  status SaleStatus required,
  created Instant required,
  lastUpdate Instant required
}
entity SaleProductRecord {
  quantity Integer required min(0),
  price BigDecimal required min(0),
  name String required minlength(1) maxlength(500),
  code String required minlength(1) maxlength(500)
}
entity SaleServiceForSaleRecord {
  quantity Integer required min(0),
  price BigDecimal required min(0),
  name String required minlength(1) maxlength(500),
  code String required minlength(1) maxlength(500)
}
entity SaleLog {
  updated Instant required,
  observation String required minlength(1) maxlength(500)
}
enum SaleStatus {
  OPEN,
  CLOSED,
  CANCELED
}

relationship OneToMany {
  Client{vehicle} to Vehicle{client},
  Client{sale} to Sale{client},
  Vehicle{sale} to Sale{vehicle},
  Sale{saleProductRecord} to SaleProductRecord{sale},
  Sale{saleServiceForSaleRecord} to SaleServiceForSaleRecord{sale},
  Sale{saleLog} to SaleLog{sale}
}
relationship ManyToOne {
  Vehicle{vehicleType(name)} to VehicleType,
  Vehicle{vehicleColor(name)} to VehicleColor,
  Vehicle{vehicleBrand(name)} to VehicleBrand
}
relationship ManyToMany {
  ServiceForSale{vehicleType} to VehicleType{serviceForSale}
}

dto VehicleType, VehicleColor, VehicleBrand, Vehicle, Product, ServiceForSale, Client, Sale, SaleProductRecord, SaleServiceForSaleRecord, SaleLog with mapstruct
paginate VehicleType, VehicleColor, VehicleBrand, Vehicle, Product, ServiceForSale, Client, Sale, SaleProductRecord, SaleServiceForSaleRecord, SaleLog with pagination
service VehicleType, VehicleColor, VehicleBrand, Vehicle, Product, ServiceForSale, Client, Sale, SaleProductRecord, SaleServiceForSaleRecord, SaleLog with serviceClass
search Vehicle, Product, ServiceForSale, Client with elasticsearch

Environment and Tools
openjdk version "11.0.4" 2019-07-16
OpenJDK Runtime Environment AdoptOpenJDK (build 11.0.4+11)
OpenJDK 64-Bit Server VM AdoptOpenJDK (build 11.0.4+11, mixed mode)
git version 2.17.1
node: v10.16.3
npm: 6.9.0
yeoman: 3.1.0
Docker version 19.03.2, build 6a30dfc
docker-compose version 1.24.1, build 4667896b
Entity configuration(s) entityName.json files generated in the .jhipster directory

Browsers and Operating System

Tested with Firefox and chrome in Ubuntu

[ X ] Checking this box is mandatory (this is just to show you read everything)

Ok, after playing a little more, and needing a translation with parameters, I realized that the translate function needs to send the parameters for the placeholders, also I do not know why this particular component uses v-bind:html instead of v-text, so, I did changed the code from
Shosssswing {{first}} - {{second}} of {{total}} items.

To
Showing {{first}} - {{second}} of {{total}} items.

If this seems the correct way to do it for you, I can prepare the pull request to fix this detail.

I can confirm, all the i18n fields with parameters are generated incorrectly, for example in the entities:

    This field is required to be at least 1 characters.

thanks for reporting this.
I need to find time to have a look
About the replace code for translation, it is here: https://github.com/jhipster/jhipster-vuejs/blob/master/generators/utils.js#L103

I can work in the changes in the week end if you want, seems like a good first issue, I just do not know if  i need to repeat the names
{ first: first, second: second, total: total }
Or if there is a more elegant way when the parameters are named as the variables