WIP: Explore removing javax.ws.rs-api

WIP: Just to know what all break so that I can figure out a fix....

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 55s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s

The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 31s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
27m 44s

trunk passed

+1 :green_heart:
compile
25m  6s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
21m 32s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
mvnsite
20m 31s

trunk passed

+1 :green_heart:
javadoc
18m 11s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
16m 57s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
shadedclient
168m 11s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 30s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
19m 23s

the patch passed

+1 :green_heart:
compile
24m  8s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javac
24m  8s

the patch passed

+1 :green_heart:
compile
21m 42s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

-1 :x:
javac
21m 42s
/results-compile-javac-root-jdkPrivateBuild-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07.txt
root-jdkPrivateBuild-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 generated 1 new + 2670 unchanged - 3 fixed = 2671 total (was 2673)

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
mvnsite
20m 29s

the patch passed

+1 :green_heart:
javadoc
18m  1s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
17m  0s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
shadedclient
82m  6s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
0m 51s

hadoop-project in the patch passed.

+1 :green_heart:
unit
1m 30s

hadoop-yarn-api in the patch passed.

-1 :x:
unit
5m  8s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt
hadoop-yarn-common in the patch passed.

-1 :x:
unit
3m 46s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
hadoop-yarn-server-applicationhistoryservice in the patch passed.

-1 :x:
unit
1m 30s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice.txt
hadoop-yarn-server-timelineservice in the patch passed.

-1 :x:
unit
101m 29s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
hadoop-yarn-server-resourcemanager in the patch passed.

-1 :x:
unit
22m 21s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
hadoop-yarn-server-nodemanager in the patch passed.

-1 :x:
unit
1m 32s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
hadoop-yarn-server-tests in the patch passed.

-1 :x:
unit
18m 56s
/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
hadoop-mapreduce-client in the patch failed.

+1 :green_heart:
unit
6m 30s

hadoop-yarn-server-timeline-pluginstorage in the patch passed.

+1 :green_heart:
unit
1m  6s

hadoop-yarn-server-timelineservice-hbase-common in the patch passed.

-1 :x:
unit
25m 33s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice-hbase-tests.txt
hadoop-yarn-server-timelineservice-hbase-tests in the patch passed.

-1 :x:
unit
1m 47s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-router.txt
hadoop-yarn-server-router in the patch passed.

-1 :x:
unit
1m  1s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-applications-distributedshell.txt
hadoop-yarn-applications-distributedshell in the patch failed.

-1 :x:
unit
1m 11s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services_hadoop-yarn-services-core.txt
hadoop-yarn-services-core in the patch failed.

+1 :green_heart:
unit
1m 38s

hadoop-yarn-applications-catalog-webapp in the patch passed.

+1 :green_heart:
unit
1m  5s

hadoop-client-runtime in the patch passed.

+1 :green_heart:
unit
0m 58s

hadoop-client-minicluster in the patch passed.

+1 :green_heart:
asflicense
1m 20s

The patch does not generate ASF License warnings.

518m 23s

Reason
Tests

Failed junit tests
hadoop.yarn.api.records.timelineservice.TestTimelineServiceRecords

hadoop.yarn.api.records.timeline.TestTimelineRecords

hadoop.yarn.util.timeline.TestShortenedFlowName

hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebApp

hadoop.yarn.server.timeline.security.TestTimelineAuthenticationFilterForV1

hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices

hadoop.yarn.server.timeline.webapp.TestTimelineWebServicesWithSSL

hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer

hadoop.yarn.server.timeline.webapp.TestTimelineWebServices

hadoop.yarn.server.timelineservice.storage.TestFileSystemTimelineReaderImpl

hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesACL

hadoop.yarn.server.timelineservice.collector.TestPerNodeTimelineCollectorsAuxService

hadoop.yarn.server.timelineservice.reader.TestTimelineUIDConverter

hadoop.yarn.server.timelineservice.collector.TestTimelineCollector

hadoop.yarn.server.timelineservice.storage.TestFileSystemTimelineWriterImpl

hadoop.yarn.server.timelineservice.collector.TestNMTimelineCollectorManager

hadoop.yarn.server.timelineservice.reader.TestTimelineReaderServer

hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServices

hadoop.yarn.server.resourcemanager.metrics.TestCombinedSystemMetricsPublisher

hadoop.yarn.server.resourcemanager.TestClientRMTokens

hadoop.yarn.server.resourcemanager.TestResourceTrackerService

hadoop.yarn.server.resourcemanager.TestRMRestart

hadoop.yarn.server.resourcemanager.metrics.TestSystemMetricsPublisherForV2

hadoop.yarn.server.resourcemanager.TestRMHATimelineCollectors

hadoop.yarn.server.resourcemanager.metrics.TestSystemMetricsPublisher

hadoop.yarn.server.nodemanager.webapp.TestNMWebServices

hadoop.yarn.server.nodemanager.containermanager.TestContainerManagerRecovery

hadoop.yarn.server.TestMiniYarnCluster

hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2

hadoop.yarn.server.TestDiskFailures

hadoop.yarn.server.TestRMNMSecretKeys

hadoop.yarn.server.timelineservice.TestTimelineServiceClientIntegration

hadoop.yarn.server.TestMiniYarnClusterNodeUtilization

hadoop.yarn.server.TestContainerManagerSecurity

hadoop.yarn.server.TestMiniYARNClusterForHA

hadoop.mapred.TestLocalDistributedCacheManager

hadoop.yarn.server.timelineservice.storage.TestTimelineWriterHBaseDown

hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction

hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity

hadoop.yarn.server.timelineservice.storage.TestTimelineReaderHBaseDown

hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage

hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities

hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps

hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageDomain

hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun

hadoop.yarn.server.router.webapp.TestRouterWebServicesREST

hadoop.yarn.server.router.clientrm.TestRouterClientRMService

hadoop.yarn.server.router.rmadmin.TestRouterRMAdminService

hadoop.yarn.server.router.clientrm.TestFederationClientInterceptorRetry

hadoop.yarn.server.router.clientrm.TestFederationClientInterceptor

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4453/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/4453

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint

uname
Linux a3279faf6b7d 4.15.0-166-generic #174-Ubuntu SMP Wed Dec 8 19:07:44 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 452ab2f292132e3bc1f5e8dbafb76771f0100e95

Default Java
Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4453/2/testReport/

Max. process+thread count
1174 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-mapreduce-project/hadoop-mapreduce-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timeline-pluginstorage hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services/hadoop-yarn-services-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp hadoop-client-modules/hadoop-client-runtime hadoop-client-modules/hadoop-client-minicluster U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4453/2/console

versions
git=2.25.1 maven=3.6.3

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 36s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+0 :ok:
xmllint
0m  1s

xmllint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s

The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 42s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
26m 23s

trunk passed

+1 :green_heart:
compile
22m 56s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
20m 30s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
mvnsite
25m 47s

trunk passed

+1 :green_heart:
javadoc
23m 43s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
22m  6s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
shadedclient
177m  9s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 32s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
19m 13s

the patch passed

+1 :green_heart:
compile
22m  3s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javac
22m  3s

the patch passed

+1 :green_heart:
compile
20m 29s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

-1 :x:
javac
20m 29s
/results-compile-javac-root-jdkPrivateBuild-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07.txt
root-jdkPrivateBuild-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 generated 1 new + 2670 unchanged - 3 fixed = 2671 total (was 2673)

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
mvnsite
25m 50s

the patch passed

+1 :green_heart:
javadoc
23m 11s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
22m 16s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
shadedclient
96m 38s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
1m  9s

hadoop-project in the patch passed.

+1 :green_heart:
unit
1m 56s

hadoop-yarn-api in the patch passed.

-1 :x:
unit
5m 40s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt
hadoop-yarn-common in the patch passed.

-1 :x:
unit
3m 52s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
hadoop-yarn-server-applicationhistoryservice in the patch passed.

-1 :x:
unit
1m 54s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice.txt
hadoop-yarn-server-timelineservice in the patch passed.

-1 :x:
unit
97m 20s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
hadoop-yarn-server-resourcemanager in the patch passed.

-1 :x:
unit
22m 57s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
hadoop-yarn-server-nodemanager in the patch passed.

-1 :x:
unit
1m 53s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
hadoop-yarn-server-tests in the patch passed.

-1 :x:
unit
18m 22s
/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
hadoop-mapreduce-client in the patch failed.

+1 :green_heart:
unit
4m 53s

hadoop-yarn-server-timeline-pluginstorage in the patch passed.

+1 :green_heart:
unit
1m 24s

hadoop-yarn-server-timelineservice-hbase-common in the patch passed.

-1 :x:
unit
21m 30s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice-hbase-tests.txt
hadoop-yarn-server-timelineservice-hbase-tests in the patch passed.

-1 :x:
unit
2m 10s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-router.txt
hadoop-yarn-server-router in the patch passed.

-1 :x:
unit
1m 22s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-applications-distributedshell.txt
hadoop-yarn-applications-distributedshell in the patch failed.

-1 :x:
unit
1m 31s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services_hadoop-yarn-services-core.txt
hadoop-yarn-services-core in the patch failed.

+1 :green_heart:
unit
1m 51s

hadoop-yarn-applications-catalog-webapp in the patch passed.

+1 :green_heart:
unit
1m  8s

hadoop-client-runtime in the patch passed.

+1 :green_heart:
unit
1m  7s

hadoop-client-minicluster in the patch passed.

+1 :green_heart:
asflicense
1m 38s

The patch does not generate ASF License warnings.

532m 40s

Reason
Tests

Failed junit tests
hadoop.yarn.api.records.timeline.TestTimelineRecords

hadoop.yarn.util.timeline.TestShortenedFlowName

hadoop.yarn.api.records.timelineservice.TestTimelineServiceRecords

hadoop.yarn.server.timeline.webapp.TestTimelineWebServicesWithSSL

hadoop.yarn.server.timeline.security.TestTimelineAuthenticationFilterForV1

hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebApp

hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer

hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices

hadoop.yarn.server.timeline.webapp.TestTimelineWebServices

hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServices

hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesACL

hadoop.yarn.server.timelineservice.reader.TestTimelineUIDConverter

hadoop.yarn.server.timelineservice.storage.TestFileSystemTimelineWriterImpl

hadoop.yarn.server.timelineservice.collector.TestTimelineCollector

hadoop.yarn.server.timelineservice.collector.TestPerNodeTimelineCollectorsAuxService

hadoop.yarn.server.timelineservice.storage.TestFileSystemTimelineReaderImpl

hadoop.yarn.server.timelineservice.reader.TestTimelineReaderServer

hadoop.yarn.server.timelineservice.collector.TestNMTimelineCollectorManager

hadoop.yarn.server.resourcemanager.metrics.TestSystemMetricsPublisherForV2

hadoop.yarn.server.resourcemanager.metrics.TestSystemMetricsPublisher

hadoop.yarn.server.resourcemanager.TestRMHATimelineCollectors

hadoop.yarn.server.resourcemanager.TestRMRestart

hadoop.yarn.server.resourcemanager.TestResourceTrackerService

hadoop.yarn.server.resourcemanager.TestClientRMTokens

hadoop.yarn.server.resourcemanager.metrics.TestCombinedSystemMetricsPublisher

hadoop.yarn.server.nodemanager.webapp.TestNMWebServices

hadoop.yarn.server.nodemanager.containermanager.TestContainerManagerRecovery

hadoop.yarn.server.TestRMNMSecretKeys

hadoop.yarn.server.TestMiniYARNClusterForHA

hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2

hadoop.yarn.server.TestMiniYarnCluster

hadoop.yarn.server.TestMiniYarnClusterNodeUtilization

hadoop.yarn.server.TestContainerManagerSecurity

hadoop.yarn.server.timelineservice.TestTimelineServiceClientIntegration

hadoop.yarn.server.TestDiskFailures

hadoop.mapred.TestLocalDistributedCacheManager

hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities

hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun

hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage

hadoop.yarn.server.timelineservice.storage.TestTimelineReaderHBaseDown

hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps

hadoop.yarn.server.timelineservice.storage.TestTimelineWriterHBaseDown

hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity

hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction

hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageDomain

hadoop.yarn.server.router.clientrm.TestFederationClientInterceptorRetry

hadoop.yarn.server.router.clientrm.TestFederationClientInterceptor

hadoop.yarn.server.router.clientrm.TestRouterClientRMService

hadoop.yarn.server.router.rmadmin.TestRouterRMAdminService

hadoop.yarn.server.router.webapp.TestRouterWebServicesREST

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4453/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/4453

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint

uname
Linux 4cc2605d25d9 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 452ab2f292132e3bc1f5e8dbafb76771f0100e95

Default Java
Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4453/1/testReport/

Max. process+thread count
1583 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-mapreduce-project/hadoop-mapreduce-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timeline-pluginstorage hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services/hadoop-yarn-services-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp hadoop-client-modules/hadoop-client-runtime hadoop-client-modules/hadoop-client-minicluster U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4453/1/console

versions
git=2.25.1 maven=3.6.3

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.


Request a specific policy

Currently, you can only request a specific PermissionSets. In real life scenarios, it's hard to predict what type of access you'll need for your temporary elevated access, and admins wish to avoid providing broad access to users eliminating human error risks.

@itaymeller. TEAM by design does not create or mutate permission sets or policies. It manages permission sets which has been created in Identity Center. You can create multiple permission sets with scoped policies for different users/job function that you anticipate would need temporary access. For example you can create a networkAdmin permission set that grants access to networking resources such as VPCs, Route53, EC2 etc and is scoped down to a specific use case instead of granting full admin access

Indeed. Hence the request. This seems low effort high value win.

@tawoyinfa
If you generate a permission set instead of re-using it you can also circumvent the issue with extending your own privileged access.
very cool product btw.

@snowstorm399 @itaymeller we'd love to hear from you. Please complete this nonobligatory feedback form. Thank you for helping us improve!


Patch: Fix switchable menu option

feat: add session switched test
feat: add boolean argument switchable to fix switchable not working

@ludndev Can you explain what you are trying to fix?

There was a problem where a feature called "switchable" wasn't working properly when users were logged in. It would disconnect but wouldn't log them back in. To fix this, I added a new arg called "switchable" with default value false. This lets them handle account switch feature properly.


[VariableFunction] Page 554 "Analysis by Dimensions"

Related to the issue #16095 please change local procedure Create CaptionSet to protect - other demands from the issue were fulfilled and do not know if this was forgotten.

Protected procedures implemented for v.20, we do not downgrade this kind of changes without CSS request

I have downloaded latest version 20.0.35986.0 and procedure CreateCaptionSet is still local and not protected

Same situation for the version 20.0.36262.0. @AlexanderYakunin - why is this issue still labeled as missing-info?

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.


Parse folder as album name

A must have feature for me would be to automatically create albums based on folder name

Hi @jsncrdnl
As I've mentioned on #33 I've created this script on top of gpup, that is doing exactly this for me.


Add resolve query param to V2 guid endpoints [OSF-6606]

Purpose
The existing behavior of the v2 guid endpoints is to simply redirect to endpoint for the resolved guid. This is fine, but doesn't play nicely with cross-origin consumers.
Adding a resolve query param changes this behavior to instead return a serialization of the guid resource like:
{
    "data": {
        "relationships": {
            "referent": {
                "links": {
                    "related": {
                        "href": "http://localhost:8000/v2/nodes/ezcuj/",
                        "meta": {
                            "type": "nodes"
                        }
                    }
                }
            }
        },
        "links": {},
        "attributes": {},
        "type": "guids",
        "id": "ezcuj"
    }
}

This can be used to resolve the guid without a redirect, and will allow consumers to embed the referent resource if desired.
Changes

Change GuidRedirect to GuidDetail
Add GuidSerializer
Add tests for serialization behavior

Side effects
None
Ticket
https://openscience.atlassian.net/browse/OSF-6606

You can't embed a referent. If you try, you get
[30/Jun/2016 13:59:04] "GET /v2/guids/qjycn/?resolve=false&embed=referent HTTP/1.1" 500 59
Traceback (most recent call last):
  File "/usr/local/Cellar/python/2.7.11/Frameworks/Python.framework/Versions/2.7/lib/python2.7/wsgiref/handlers.py", line 85, in run
    self.result = application(self.environ, self.start_response)
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/django/contrib/staticfiles/handlers.py", line 63, in __call__
    return self.application(environ, start_response)
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/django/core/handlers/wsgi.py", line 177, in __call__
    response = self.get_response(request)
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/django/core/handlers/base.py", line 230, in get_response
    response = self.handle_uncaught_exception(request, resolver, sys.exc_info())
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/django/core/handlers/base.py", line 149, in get_response
    response = self.process_exception_by_middleware(e, request)
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/django/core/handlers/base.py", line 147, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/django/views/generic/base.py", line 68, in view
    return self.dispatch(request, *args, **kwargs)
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/rest_framework/views.py", line 466, in dispatch
    response = self.handle_exception(exc)
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/rest_framework/views.py", line 463, in dispatch
    response = handler(request, *args, **kwargs)
  File "/Users/bgeiger/cos/osf/api/guids/views.py", line 59, in get
    return super(GuidDetail, self).get(request, **kwargs)
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/rest_framework/generics.py", line 210, in get
    return self.retrieve(request, *args, **kwargs)
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/rest_framework/mixins.py", line 58, in retrieve
    return Response(serializer.data)
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/rest_framework/serializers.py", line 503, in data
    ret = super(Serializer, self).data
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/rest_framework/serializers.py", line 239, in data
    self._data = self.to_representation(self.instance)
  File "/Users/bgeiger/cos/osf/api/base/serializers.py", line 1019, in to_representation
    result = self.context['embed'][field.field_name](obj)
  File "/Users/bgeiger/cos/osf/api/base/views.py", line 40, in partial
    v, view_args, view_kwargs = field.resolve(item, field_name)
  File "/Users/bgeiger/cos/osf/api/base/serializers.py", line 384, in resolve
    lookup_url_kwarg = lookup_url_kwarg(getattr(resource, field_name))
  File "/Users/bgeiger/cos/osf/api/guids/serializers.py", line 21, in get_related_view_kwargs
    record = guid.referent
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/modularodm/storedobject.py", line 95, in wrapped
    return func(this, *args, **kwargs)
  File "/Users/bgeiger/Envs/osf/lib/python2.7/site-packages/modularodm/storedobject.py", line 935, in __getattr__
    raise AttributeError(errmsg)
AttributeError: User object has no attribute referent

I think it would still be appropriate to fill out the links field with self and html entries.

Pass done. Hopefully the embedding thing won't be too hard. As internal-only, it's not strictly necessary, but I worry that it's a symptom of something that's incorrectly implemented which may cause other problems later. 🐧

You can't embed a referent.
I'll look at this

I think it would still be appropriate to fill out the links field with self and html entries.
It's a pretty non-trivial amount of additional hackery to get this working. Dynamic properties of RelationshipFields are sort of tricky to add. If it's important I'll add it, but does the benefit outweigh the cost?

The links are not vital. Again, internal-only, so should be okay. If we every wanted to expose the functionality, though, I would definitely include them.

That being said, it's the links for the guids, so it should be "self": "https://api.osf.io/v2/guids/ezcuj/" and "html": "https://osf.io/ezcuj/", so I wouldn't expect that to be too terrible.

I updated the description with an ideal view of the output without embeds.

Looks awesome. 🎉 🐧 🎉

Please hold until we figure out the correct way to generate relationship urls for files.

@brianjgeiger @sloria @pattisdr
Does it seem reasonable to allow api/v2/files/<file_id> to respect guids as file ids? This could be a fallback if the regular id lookup fails.

I would check what Comments is doing, since they have to track by file guid. Though I just looked through and didn't see anything. Hmm.
I'm not opposed to having the file lookup work with GUIDs as well; that seems like a valid use case as long as you 404 any guids that aren't files being accessed that way. Obvs, it should be efficient and it should work, but philosophically it seems correct behavior.

@brianjgeiger File comments are fetched using a filter on the node comments endpoint. Probably not a tenable solution here.

I meant more that file comments should have a target of a file, and that file will have to have a guid to be trackable, so I would presume that the file is directly or indirectly being acquired by its guid.

AFIK it's impossible to comment on a file until after it's guid has been assigned. This is a known complication with supporting comments in ember-osf.
Taking a stab at this... we can revert if the solution doesn't work out.

Does it seem reasonable to allow api/v2/files/<file_id> to respect guids as file ids? This could be a fallback if the regular id lookup fails.

Sounds fine to me.

Sam, I think we're talking about different things and that I am not being helpful. You go forward with what you're doing. 👍

Does it seem reasonable to allow api/v2/files/ to respect guids as file ids? This could be a fallback if the regular id lookup fails.

I also agree. I see no reason why it wouldn't be allowed, and having a fallback seems like a good idea.

Okay, this meets all my expectations. If tests pass, I'm good with it. 🎉 🐧 🎉


Start using browser-ui-test framework

This is just a POC for the moment with not much done. It currently just checks that clicking on the "my favorites" button, it goes to the expected panel. It also doesn't use screenshot generation/comparison.

Before diving too deep into this, can you explain what the rationale is?
Is it to simplify test writing and maintenance, or to enable screenshot comparison capabilities, or smth else?
In the first two cases, I think a lot could be done with the current tools to improve the experience instead of introducing a very new tool.

I had in mind the screenshot mainly. However I find the syntax much simpler but not sure it would allow to cover all what we currently have. To be debated.

Let's focus on improving upon our current test tooling instead of switching to a very new stack.


testing gnpy after fresh install: error running examples

2018-04-16: after testing the installation using pip install I realized that timestamps in the local folder gnpy were older than the master (see separate issues)

Then I deleted an older gnpy folder and started afresh,  cloning from master.
the timestamps of files were actual (as expected)
running the first example from Readme --> no success
running second example from Readme --> no success

IOW I wasn't able to run the examples from Readme
ggrammel-mbp:github ggrammel$ git clone https://github.com/Telecominfraproject/gnpy**
Cloning into 'gnpy'...
remote: Counting objects: 694, done.
remote: Compressing objects: 100% (8/8), done.
remote: Total 694 (delta 1), reused 3 (delta 0), pack-reused 685
Receiving objects: 100% (694/694), 349.50 KiB | 501.00 KiB/s, done.
Resolving deltas: 100% (365/365), done.

ggrammel-mbp:github ggrammel$ cd gnpy
ggrammel-mbp:gnpy ggrammel$ python setup.py install
/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/distutils/dist.py:261: UserWarning: Unknown distribution option: 'long_description_content_type'
  warnings.warn(msg)
running install
running bdist_egg
running egg_info
creating gnpy.egg-info
writing gnpy.egg-info/PKG-INFO
writing dependency_links to gnpy.egg-info/dependency_links.txt
writing requirements to gnpy.egg-info/requires.txt
writing top-level names to gnpy.egg-info/top_level.txt
writing manifest file 'gnpy.egg-info/SOURCES.txt'
reading manifest file 'gnpy.egg-info/SOURCES.txt'
writing manifest file 'gnpy.egg-info/SOURCES.txt'
installing library code to build/bdist.macosx-10.6-intel/egg
running install_lib
running build_py
creating build
creating build/lib
creating build/lib/gnpy
copying gnpy/__init__.py -> build/lib/gnpy
creating build/lib/gnpy/core
copying gnpy/core/__init__.py -> build/lib/gnpy/core
copying gnpy/core/elements.py -> build/lib/gnpy/core
copying gnpy/core/execute.py -> build/lib/gnpy/core
copying gnpy/core/info.py -> build/lib/gnpy/core
copying gnpy/core/network.py -> build/lib/gnpy/core
copying gnpy/core/node.py -> build/lib/gnpy/core
copying gnpy/core/units.py -> build/lib/gnpy/core
copying gnpy/core/utils.py -> build/lib/gnpy/core
creating build/bdist.macosx-10.6-intel
creating build/bdist.macosx-10.6-intel/egg
creating build/bdist.macosx-10.6-intel/egg/gnpy
copying build/lib/gnpy/__init__.py -> build/bdist.macosx-10.6-intel/egg/gnpy
creating build/bdist.macosx-10.6-intel/egg/gnpy/core
copying build/lib/gnpy/core/__init__.py -> build/bdist.macosx-10.6-intel/egg/gnpy/core
copying build/lib/gnpy/core/elements.py -> build/bdist.macosx-10.6-intel/egg/gnpy/core
copying build/lib/gnpy/core/execute.py -> build/bdist.macosx-10.6-intel/egg/gnpy/core
copying build/lib/gnpy/core/info.py -> build/bdist.macosx-10.6-intel/egg/gnpy/core
copying build/lib/gnpy/core/network.py -> build/bdist.macosx-10.6-intel/egg/gnpy/core
copying build/lib/gnpy/core/node.py -> build/bdist.macosx-10.6-intel/egg/gnpy/core
copying build/lib/gnpy/core/units.py -> build/bdist.macosx-10.6-intel/egg/gnpy/core
copying build/lib/gnpy/core/utils.py -> build/bdist.macosx-10.6-intel/egg/gnpy/core
byte-compiling build/bdist.macosx-10.6-intel/egg/gnpy/__init__.py to __init__.cpython-36.pyc
byte-compiling build/bdist.macosx-10.6-intel/egg/gnpy/core/__init__.py to __init__.cpython-36.pyc
byte-compiling build/bdist.macosx-10.6-intel/egg/gnpy/core/elements.py to elements.cpython-36.pyc
byte-compiling build/bdist.macosx-10.6-intel/egg/gnpy/core/execute.py to execute.cpython-36.pyc
byte-compiling build/bdist.macosx-10.6-intel/egg/gnpy/core/info.py to info.cpython-36.pyc
byte-compiling build/bdist.macosx-10.6-intel/egg/gnpy/core/network.py to network.cpython-36.pyc
byte-compiling build/bdist.macosx-10.6-intel/egg/gnpy/core/node.py to node.cpython-36.pyc
byte-compiling build/bdist.macosx-10.6-intel/egg/gnpy/core/units.py to units.cpython-36.pyc
byte-compiling build/bdist.macosx-10.6-intel/egg/gnpy/core/utils.py to utils.cpython-36.pyc
creating build/bdist.macosx-10.6-intel/egg/EGG-INFO
copying gnpy.egg-info/PKG-INFO -> build/bdist.macosx-10.6-intel/egg/EGG-INFO
copying gnpy.egg-info/SOURCES.txt -> build/bdist.macosx-10.6-intel/egg/EGG-INFO
copying gnpy.egg-info/dependency_links.txt -> build/bdist.macosx-10.6-intel/egg/EGG-INFO
copying gnpy.egg-info/requires.txt -> build/bdist.macosx-10.6-intel/egg/EGG-INFO
copying gnpy.egg-info/top_level.txt -> build/bdist.macosx-10.6-intel/egg/EGG-INFO
zip_safe flag not set; analyzing archive contents...
creating dist
creating 'dist/gnpy-0.1.3-py3.6.egg' and adding 'build/bdist.macosx-10.6-intel/egg' to it
removing 'build/bdist.macosx-10.6-intel/egg' (and everything under it)
Processing gnpy-0.1.3-py3.6.egg
Copying gnpy-0.1.3-py3.6.egg to /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Adding gnpy 0.1.3 to easy-install.pth file

Installed /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy-0.1.3-py3.6.egg
Processing dependencies for gnpy==0.1.3
Searching for xlrd==1.1.0
Best match: xlrd 1.1.0
Adding xlrd 1.1.0 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for urllib3==1.22
Best match: urllib3 1.22
Adding urllib3 1.22 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for sphinxcontrib-websupport==1.0.1
Best match: sphinxcontrib-websupport 1.0.1
Adding sphinxcontrib-websupport 1.0.1 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for sphinxcontrib-bibtex==0.3.6
Best match: sphinxcontrib-bibtex 0.3.6
Adding sphinxcontrib-bibtex 0.3.6 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for Sphinx==1.6.6
Best match: Sphinx 1.6.6
Adding Sphinx 1.6.6 to easy-install.pth file
Installing sphinx-apidoc script to /Library/Frameworks/Python.framework/Versions/3.6/bin
Installing sphinx-autogen script to /Library/Frameworks/Python.framework/Versions/3.6/bin
Installing sphinx-build script to /Library/Frameworks/Python.framework/Versions/3.6/bin
Installing sphinx-quickstart script to /Library/Frameworks/Python.framework/Versions/3.6/bin

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for snowballstemmer==1.2.1
Best match: snowballstemmer 1.2.1
Adding snowballstemmer 1.2.1 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for six==1.11.0
Best match: six 1.11.0
Adding six 1.11.0 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for scipy==1.0.0
Best match: scipy 1.0.0
Adding scipy 1.0.0 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for requests==2.18.4
Best match: requests 2.18.4
Adding requests 2.18.4 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for PyYAML==3.12
Best match: PyYAML 3.12
Adding PyYAML 3.12 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for pytz==2017.3
Best match: pytz 2017.3
Adding pytz 2017.3 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for python-dateutil==2.6.1
Best match: python-dateutil 2.6.1
Adding python-dateutil 2.6.1 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for pytest==3.3.2
Best match: pytest 3.3.2
Adding pytest 3.3.2 to easy-install.pth file
Installing py.test script to /Library/Frameworks/Python.framework/Versions/3.6/bin
Installing pytest script to /Library/Frameworks/Python.framework/Versions/3.6/bin

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for pyparsing==2.2.0
Best match: pyparsing 2.2.0
Adding pyparsing 2.2.0 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for Pygments==2.2.0
Best match: Pygments 2.2.0
Adding Pygments 2.2.0 to easy-install.pth file
Installing pygmentize script to /Library/Frameworks/Python.framework/Versions/3.6/bin

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for pybtex-docutils==0.2.1
Best match: pybtex-docutils 0.2.1
Adding pybtex-docutils 0.2.1 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for pybtex==0.21
Best match: pybtex 0.21
Adding pybtex 0.21 to easy-install.pth file
Installing pybtex script to /Library/Frameworks/Python.framework/Versions/3.6/bin
Installing pybtex-convert script to /Library/Frameworks/Python.framework/Versions/3.6/bin
Installing pybtex-format script to /Library/Frameworks/Python.framework/Versions/3.6/bin

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for py==1.5.2
Best match: py 1.5.2
Adding py 1.5.2 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for pluggy==0.6.0
Best match: pluggy 0.6.0
Adding pluggy 0.6.0 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for oset==0.1.3
Best match: oset 0.1.3
Adding oset 0.1.3 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for numpy==1.13.3
Best match: numpy 1.13.3
Adding numpy 1.13.3 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for networkx==2.0
Best match: networkx 2.0
Adding networkx 2.0 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for matplotlib==2.1.0
Best match: matplotlib 2.1.0
Adding matplotlib 2.1.0 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for MarkupSafe==1.0
Best match: MarkupSafe 1.0
Adding MarkupSafe 1.0 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for latexcodec==1.0.5
Best match: latexcodec 1.0.5
Adding latexcodec 1.0.5 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for Jinja2==2.10
Best match: Jinja2 2.10
Adding Jinja2 2.10 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for imagesize==0.7.1
Best match: imagesize 0.7.1
Adding imagesize 0.7.1 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for idna==2.6
Best match: idna 2.6
Adding idna 2.6 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for docutils==0.14
Best match: docutils 0.14
Adding docutils 0.14 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for decorator==4.1.2
Best match: decorator 4.1.2
Adding decorator 4.1.2 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for cycler==0.10.0
Best match: cycler 0.10.0
Adding cycler 0.10.0 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for chardet==3.0.4
Best match: chardet 3.0.4
Adding chardet 3.0.4 to easy-install.pth file
Installing chardetect script to /Library/Frameworks/Python.framework/Versions/3.6/bin

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for certifi==2017.11.5
Best match: certifi 2017.11.5
Adding certifi 2017.11.5 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for Babel==2.5.3
Best match: Babel 2.5.3
Adding Babel 2.5.3 to easy-install.pth file
Installing pybabel script to /Library/Frameworks/Python.framework/Versions/3.6/bin

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for attrs==17.4.0
Best match: attrs 17.4.0
Adding attrs 17.4.0 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for alabaster==0.7.10
Best match: alabaster 0.7.10
Adding alabaster 0.7.10 to easy-install.pth file

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Searching for setuptools==38.5.1
Best match: setuptools 38.5.1
Adding setuptools 38.5.1 to easy-install.pth file
Installing easy_install script to /Library/Frameworks/Python.framework/Versions/3.6/bin
Installing easy_install-3.6 script to /Library/Frameworks/Python.framework/Versions/3.6/bin

Using /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages
Finished processing dependencies for gnpy==0.1.3

ggrammel-mbp:gnpy ggrammel$ python examples/transmission_main_example.py
Traceback (most recent call last):
  File "examples/transmission_main_example.py", line 90, in <module>
    exit(main(args))
  File "examples/transmission_main_example.py", line 41, in main
    network = network_from_json(json_data)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy/core/network.py", line 29, in network_from_json
    g.add_node(getattr(elements, el_config['type'])(el_config))
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy/core/elements.py", line 222, in __init__
    super().__init__(config)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy/core/node.py", line 48, in __init__
    self.config = ConfigStruct(**config)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy/core/node.py", line 31, in __init__
    json_config = load_json(config['config_from_json'])
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy/core/utils.py", line 20, in load_json
    with open(filename, 'r') as f:
FileNotFoundError: [Errno 2] No such file or directory: 'edfa_config.json'

ggrammel-mbp:gnpy ggrammel$ python examples/transmission_main_example.py examples/coronet_conus_example.json
Traceback (most recent call last):
  File "examples/transmission_main_example.py", line 90, in <module>
    exit(main(args))
  File "examples/transmission_main_example.py", line 42, in main
    build_network(network)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy/core/network.py", line 119, in build_network
    network = split_fiber(network, fiber)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy/core/network.py", line 86, in split_fiber
    network = add_egress_amplifier(network, prev_node)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy/core/network.py", line 108, in add_egress_amplifier
    new_edfa = Edfa(config)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy/core/elements.py", line 222, in __init__
    super().__init__(config)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy/core/node.py", line 48, in __init__
    self.config = ConfigStruct(**config)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy/core/node.py", line 31, in __init__
    json_config = load_json(config['config_from_json'])
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/gnpy/core/utils.py", line 20, in load_json
    with open(filename, 'r') as f:
FileNotFoundError: [Errno 2] No such file or directory: 'edfa_config.json'
ggrammel-mbp:gnpy ggrammel$
ggrammel-mbp:gnpy ggrammel$ ls -l examples/
total 296
-rw-r--r--   1 ggrammel  wheel  132604 Apr 16 19:19 coronet_conus_example.json
drwxr-xr-x   7 ggrammel  wheel     238 Apr 16 19:19 edfa
-rw-r--r--   1 ggrammel  wheel    9973 Apr 16 19:19 edfa_config.json
drwxr-xr-x  12 ggrammel  wheel     408 Apr 16 19:19 edfa_model
-rw-r--r--   1 ggrammel  wheel    3241 Apr 16 19:19 transmission_main_example.py
ggrammel-mbp:gnpy ggrammel$

I have this running correctly if you run it from the examples directory..running from the top level like this causes this error.

OK, that seems to work, but what is the action now

Changing the Readme or
Making sure the Readme works as-is?

From: stevec2810<EMAIL_ADDRESS>Reply-To: Telecominfraproject/gnpy<EMAIL_ADDRESS>Date: Monday, April 16, 2018 at 19:58
To: Telecominfraproject/gnpy<EMAIL_ADDRESS>Cc: Gert Grammel<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [Telecominfraproject/gnpy] testing gnpy after fresh install: error running examples (#55)
I have this running correctly if you run it from the examples directory..running from the top level like this causes this error.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Telecominfraproject_gnpy_issues_55-23issuecomment-2D381694483&d=DwMCaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=Sf-T94Aod4TTEURQzTXYYw-Q-H8PyeOsweqqcNyVIcU&m=0yFYQY4qHiS43t4YkVLTpShB90GgAddn7tODwILncgg&s=tsszermW7w9IFqe6VXtkjWXoY_Otyyidc4R77yPAgK0&e=, or mute the threadhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AOcHVDz4AD15jn0LVXr-2DaXt7y1FV3wA8ks5tpNvagaJpZM4TW9j6&d=DwMCaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=Sf-T94Aod4TTEURQzTXYYw-Q-H8PyeOsweqqcNyVIcU&m=0yFYQY4qHiS43t4YkVLTpShB90GgAddn7tODwILncgg&s=4dQmMEJPLdV-ugqiDvia43gr2dV8KYHj4sO7fbKapQE&e=.

2018-04-18: issue still present!
needs to be fixed with high priority as users following the Readme file experience errors which look like a broken master repository.

Fix: Replace Readme:
gnpy: mesh optical network route planning and optimization library
|docs| |build|
gnpy is an open-source, community-developed library for building route planning
and optimization tools in real-world mesh optical networks.
gnpy <http://github.com/telecominfraproject/gnpy>__ is:

a sponsored project of the OOPT/PSE <http://telecominfraproject.com/project-groups-2/backhaul-projects/open-optical-packet-transport/>_ working group of the Telecom Infra Project <http://telecominfraproject.com>_.
fully community-driven, fully open source library
driven by a consortium of operators, vendors, and academic researchers
intended for rapid development of production-grade route planning tools
easily extensible to include custom network elements
performant to the scale of real-world mesh optical networks

Documentation: https://gnpy.readthedocs.io
Installation
gnpy is hosted in the Python Package Index <http://pypi.org/>_ (gnpy <https://pypi.org/project/gnpy/>__). It can be installed via:
.. code-block:: shell
$ pip install gnpy

It can also be installed directly from the repo.
.. code-block:: shell
$ git clone https://github.com/telecominfraproject/gnpy
$ cd gnpy
$ python setup.py install

Both approaches above will handle installing any additional software dependencies.
**Note**: *We recommend the use of the Anaconda Python distribution
(https://www.anaconda.com/download) which comes with many scientific
computing dependencies pre-installed.*

Instructions for Use
gnpy is a library for building route planning and optimization tools.
It ships with a number of example programs. Release versions will ship with
fully-functional programs.
**Note**: *If you are a network operator or involved in route planning and
optimization for your organization, please contact project chairs or maintainer James
Powell <james.powell@telecominfraproject>. gnpy is looking for users with
specific, delineated use cases to drive requirements for future
development.*

To get started, run the transmission example:
Note: * examples need to be launched from the examples folder*
.. code-block:: shell
$ cd examples
$ python transmission_main_example.py

By default, this script operates on a single span network defined in examples/edfa/edfa_example_network.json <examples/edfa/edfa_example_network.json>_
You can specify a different network at the command line as follows. For
example, to use the CORONET Continental US (CONUS) network defined in examples/coronet_conus_example.json <examples/coronet_conus_example.json>_:
.. code-block:: shell
$ python transmission_main_example.py coronet_conus_example.json
This script will calculate the average signal osnr and snr across 93 network
elements (transceiver, ROADMs, fibers, and amplifiers) between Abilene, Texas
and Albany, New York.
This script calculates the average signal OSNR = |OSNR| and SNR = |SNR|.
.. |OSNR| replace:: P\ :sub:ch\ /P\ :sub:ase
.. |SNR| replace:: P\ :sub:ch\ /(P\ :sub:nli\ +\ P\ :sub:ase)
|Pase| is the amplified spontaneous emission noise, and |Pnli| the non-linear
interference noise.
.. |Pase| replace:: P\ :sub:ase
.. |Pnli| replace:: P\ :sub:nli
The transmission_main_example.py <examples/transmission_main_example.py>_
script propagates a specrum of 96 channels at 32 Gbaud, 50 GHz spacing and 0
dBm/channel. These are not yet parametrized but can be modified directly in the
script (via the SpectralInformation tuple) to accomodate any baud rate,
spacing, power or channel count demand.
The amplifier's gain is set to exactly compsenate for the loss in each network
element. The amplifier is currently defined with gain range of 15 dB to 25 dB
and 21 dBm max output power. Ripple and NF models are defined in
examples/edfa_config.json <examples/edfa_config.json>_
Contributing
gnpy is looking for additional contributors, especially those with experience
planning and maintaining large-scale, real-world mesh optical networks.
To get involved, please contact James Powell
<EMAIL_ADDRESS>or Gert Grammel<EMAIL_ADDRESS>gnpy contributions are currently limited to members of TIP <http://telecominfraproject.com>_. Membership is free and open to all.
See the Onboarding Guide <https://github.com/Telecominfraproject/gnpy/wiki/Onboarding-Guide>_ for
specific details on code contribtions.
See AUTHORS.rst <AUTHORS.rst>_ for past and present contributors.
Project Background
Data Centers are built upon interchangeable, highly standardized node and
network architectures rather than a sum of isolated solutions. This also
translates to optical networking. It leads to a push in enabling multi-vendor
optical network by disaggregating HW and SW functions and focussing on
interoperability. In this paradigm, the burden of responsibility for ensuring
the performance of such disaggregated open optical systems falls on the
operators. Consequently, operators and vendors are collaborating in defining
control models that can be readily used by off-the-shelf controllers. However,
node and network models are only part of the answer. To take reasonable
decisions, controllers need to incorporate logic to simulate and assess optical
performance. Hence, a vendor-independent optical quality estimator is required.
Given its vendor-agnostic nature, such an estimator needs to be driven by a
consortium of operators, system and component suppliers.
Founded in February 2016, the Telecom Infra Project (TIP) is an
engineering-focused initiative which is operator driven, but features
collaboration across operators, suppliers, developers, integrators, and
startups with the goal of disaggregating the traditional network deployment
approach. The group’s ultimate goal is to help provide better connectivity for
communities all over the world as more people come on-line and demand more
bandwidth- intensive experiences like video, virtual reality and augmented
reality.
Within TIP, the Open Optical Packet Transport (OOPT) project group is chartered
with unbundling monolithic packet-optical network technologies in order to
unlock innovation and support new, more flexible connectivity paradigms.
The key to unbundling is the ability to accurately plan and predict the
performance of optical line systems based on an accurate simulation of optical
parameters. Under that OOPT umbrella, the Physical Simulation Environment (PSE)
working group set out to disrupt the planning landscape by providing an open
source simulation model which can be used freely across multiple vendor
implementations.
.. |docs| image:: https://readthedocs.org/projects/gnpy/badge/?version=develop
:target: http://gnpy.readthedocs.io/en/develop/?badge=develop
:alt: Documentation Status
:scale: 100%
.. |build| image:: https://travis-ci.org/mcantono/gnpy.svg?branch=develop
:target: https://travis-ci.org/mcantono/gnpy
:alt: Build Status
:scale: 100%
TIP OOPT/PSE & PSE WG Charter
We believe that openly sharing ideas, specifications, and other intellectual
property is the key to maximizing innovation and reducing complexity
TIP OOPT/PSE's goal is to build an end-to-end simulation environment which
defines the network models of the optical device transfer functions and their
parameters.  This environment will provide validation of the optical
performance requirements for the TIP OLS building blocks.

The model may be approximate or complete depending on the network complexity.
Each model shall be validated against the proposed network scenario.
The environment must be able to process network models from multiple vendors,
and also allow users to pick any implementation in an open source framework.
The PSE will influence and benefit from the innovation of the DTC, API, and
OLS working groups.
The PSE represents a step along the journey towards multi-layer optimization.

License
gnpy is distributed under a standard BSD 3-Clause License.
See LICENSE <LICENSE>__ for more details.

Could you submit a pull request against the develop branch with your fixes? Thanks

simply trying to fix master asap. Don't know if the fix is applicable to the develop branch. We can probably deal with that later.

created pull request

Since pull request directly to master was rejected, I added another pull request for develop with the expectation that the README file will be pulled through into master without further delays. By following the new README it should now be possible to run gnpy examples on master without throwing errors.

seems the develop branch has now been committed to master. Did you check if the Readme now still fits to the new Example files? The README was weitten for the original master and was was not tested with develop (see above).

after some testing figured out that the solution is to set PYTHONPATH to the gnpy directory
please add this to the README so that the current master examples can run without errors

Cloning and running from the repo is a workflow targeting code contributors. They should already be familiar with the use of PYTHONPATH. We probably don't need to document all the details of how Python works, since we can expect that code contributors will be broadly aware of this.
The workflow for non-code contributors is to use the Binder link. If there are Binder errors, these users can submit Github issues for us to resolve (where there the cause is on the side of gnpy.)

Code contributors are working on their own branch and commit to develop. The issue here is related to the master branch. Master shall allow users who feel comfortable with installing python programs to run gnpy examples as described without errors.
re-opening the issue as the action item from the PSE-Group call still needs to be addressed:
James: Examples described in README on Master branch shall work without errors. Target 2018-04-26

What has been pushed to master?
From: Brian Taylor<EMAIL_ADDRESS>Reply-To: Telecominfraproject/gnpy<EMAIL_ADDRESS>Date: Friday, April 27, 2018 at 18:35
To: Telecominfraproject/gnpy<EMAIL_ADDRESS>Cc: Gert Grammel<EMAIL_ADDRESS>State change<EMAIL_ADDRESS>Subject: Re: [Telecominfraproject/gnpy] testing gnpy after fresh install: error running examples (#55)
It was agreement of the whole team that nothing gets pushed to master. So not sure why things are getting pushed to master. Pushing to master requires team consensus.
Thanks-
Brian
From: Gert Grammel<EMAIL_ADDRESS>Reply-To: Telecominfraproject/gnpy<EMAIL_ADDRESS>Date: Friday, April 27, 2018 at 8:36 AM
To: Telecominfraproject/gnpy<EMAIL_ADDRESS>Cc: Subscribed<EMAIL_ADDRESS>Subject: Re: [Telecominfraproject/gnpy] testing gnpy after fresh install: error running examples (#55)
Code contributors are working on their own branch and commit to develop. The issue here is related to the master branch. Master shall allow users who feel comfortable with installing python programs to run gnpy examples as described without errors.
re-opening the issue as the action item from the PSE-Group call still needs to be addressed:
James: Examples described in README on Master branch shall work without errors. Target 2018-04-26
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/Telecominfraproject/gnpy/issues/55#issuecomment-384957078, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AS3WCWwZI030t32RGhSQGvNUVbSOGsOeks5tsxCZgaJpZM4TW9j6.
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Telecominfraproject_gnpy_issues_55-23issuecomment-2D385022161&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=Sf-T94Aod4TTEURQzTXYYw-Q-H8PyeOsweqqcNyVIcU&m=kogprJt3kbzCsOqwutOSIkDDH3mO-cVqkYiNg6EiFlI&s=agB9FLwVvJ_WIxEkKCR0Sl_aogWddFDuO3Ta-UYX7TM&e=, or mute the threadhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AOcHVLgbRSn1LYpBtfjIkLiwJbASF2hGks5ts0jMgaJpZM4TW9j6&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=Sf-T94Aod4TTEURQzTXYYw-Q-H8PyeOsweqqcNyVIcU&m=kogprJt3kbzCsOqwutOSIkDDH3mO-cVqkYiNg6EiFlI&s=1QQ0zZFI4qIF_FaWm5Hcd2eIdRatS_pb2eVDaUvPaZk&e=.

Master is supposed to be always deployable. Today Examples described in Readme on Master branch still don't work without errors.
What kept us off fixing it and how is it planned to be addressed?

roll back to previous master branch and keep Readme provided two weeks ago?
keep current master but update Readme to avoid running into error conditions?
We should aim to  address such externally visible issues right away - in particular since they seem trivial to resolve. Keeping such things open for long doesn't inspire trust and turns folks away who wanted to try it out but run into error conditions.
A solution is overdue

Followed readme in https://github.com/Telecominfraproject/gnpy/tree/master
...
$ git clone https://github.com/telecominfraproject/gnpy
$ cd gnpy
$ python setup.py install
$ cd examples
$ python transmission_main_example.py
and ran into the same condition as reported April 26:
ggrammel-mbp:examples ggrammel$ python transmission_main_example.py
Traceback (most recent call last):
  File "transmission_main_example.py", line 14, in <module>
    from gnpy.core.equipment import read_eqpt_library
ModuleNotFoundError: No module named 'gnpy.core.equipment'

Thought it was already fixed as reported on Tue call.


[Feature Request]   Modified 'error'-handling:  'repeat'-button or automatic loop

People say, only an insane person repeats an action that has proved successless.
After some times receiving an 'error' trying to enter an URL,
first I erratically changed the method (drag&drop, ctrl-c, ctrl-v, ...),
and sometimes it was successful, and sometimes not.
After a lot of trial and error I did not find any systematical conclusion or solution to this problem.
Then I switched to do, what is known as totally useless,
I simply repeated exactly what had proven successless.
Not only once, but sometimes more than 10 times.
And in every case I got an 'error', and an 'error' again, and again and again.
But suddenly, without any alteration of the procedure, a 'queued' appeared.
This worked for all URLs I tried, sometimes after 3 or 4 attempts,
in few cases it needed more than 10, but it was in the end always successful.
Only, it is really annoying having to first remove the unsuccessful item,
then reentering the same URL, receiving the 'error'
and knowing having to repeat this loop an unforseeable number of repetations.
Is it easyer to implement a new 'repeat'-button,
or,
even more comfortable for the user,
a simple loop repeating up to 20 times before ending
(and showing 'error' if still no success, but that never occurred during my trials) ...
Thank you very much!

Is the error from yt-dlp Incomplete data received? I've been getting that for YouTube playlists, and I've already implemented a workaround. I think I will also add a refresh command to the context menu.

Just having written the above, now I eperienced for the first time
a case that could not be solved by only repeating the entering process:
Here the problem was, that one members-only-video was in the playlist.
So the problem here could be solved (incomplete)
by opening the original URL in the browser
and entering every single video's URL separately from there
(besides the one for members only).
For such cases another command in the context menu could be helpful, too:
'copy the original URL to the clipboard',
and maybe even a third one:
'open the original URL in the browser'

And, yes, the most errors resulted from 'Incomplete data received'.

You can now update to the latest version of yt-dlp on the nightly release channel, to get rid of the Incomplete data received error.

Thank you very much!


build: check crd change

Codecov Report

Merging #4 (83f8117) into main (0c87ca8) will not change coverage.
The diff coverage is n/a.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files
@@           Coverage Diff           @@
##             main       #4   +/-   ##
=======================================
  Coverage   68.55%   68.55%
=======================================
  Files          13       13
  Lines         690      690
=======================================
  Hits          473      473
  Misses        166      166
  Partials       51       51

Flag
Coverage Δ

certificate-operator
68.55% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.


Set tf-strict-deabstraction to true as default.

TensorFlow/debug_scope.swift are still failing. This PR sets the tf-strict-deabstraction flag to false in this tests.

@swift-ci please test tensorflow


Make api/implementation work for testing too

The api/implementation configurations were ignored for test compilation and runtime
until now, meaning that all api dependencies were missing during compilation
and all implementation dependencies were missing at test runtime. Instead the default
configuration was used for both cases.
The fix was simply to add the usage attribute to the compile/runtime classpath configuration
of all sourceSets instead of just the main one.

I'll do the tests and backwards compatibility fix for the war/ear plugin in another PR.

@melix is this good from your side?

Ok


fix(kona-derive): Remove DataIter Option Return

Description
Previously, the DataIter returned an Option<Result<...>>.
Whenever the Option was None, the downstream consumers would just return a StageError::Eof. Instead, this PR removes the Option, and returns a StageError::Eof directly if the Option is of variant None.

#405  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @refcell and the rest of your teammates on  Graphite

Codecov Report
Attention: Patch coverage is 69.23077% with 12 lines in your changes missing coverage. Please review.

Project coverage is 77.8%. Comparing base (4c367d8) to head (9eacbbd).

Files
Patch %
Lines

crates/derive/src/sources/blobs.rs
0.0%
7 Missing :warning:

crates/plasma/src/source.rs
76.1%
5 Missing :warning:

Additional details and impacted files

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


[Suggestion] Add spawning spheres

When you toggle on the overlays, the mod could create an overlay that displays where mobs can spawn around the player. This would be really useful for building efficient mob farms, and seems as though it wouldn't be too hard to add.

It already exists as /bbor:spawningSphere


Fix for redirect vuln could go one step further to solve unvalidated_redirects_spec.rb breakage

As is, the line to shave off different domains in the redirect path = URI.parse(params[:url]).path if params[:url].present? can still lead to an invalid route, and in fact the unvalidated_redirects_spec.rb will blow up on an exception rather than just go to pending when this fix is in place. Adding a check on the route can save that problem as well:
    path = home_dashboard_index_path
    begin
      path = URI.parse(params[:url]).path if params[:url].present?
      Rails.application.routes.recognize_path(path) # raises if invalid
    rescue
      path = home_dashboard_index_path
    end

Closing this as #228 has more info on the same issue.


Breakpoints are not working as expected

Issue Type: Bug
I'm going to be brief, because this feels like a regression of
ts-jest (and maybe ts-node) files do not get source mapped when debugging. · Issue #1100 · microsoft/vscode-js-debug
Insider build a few days ago was working. After updating today, it stopped.
Now my breakpoints get moved to a random location and may or may not stop.
I'll try the steps listed in https://github.com/microsoft/vscode/issues/133138#issuecomment-921943687
I know it is not related to the issue, but I have to express my frustration at how painful this breakpoint issue has made debugging Extensions and Tests the past few months.
Please keep up the good work with VS Code.
 Do you have a repo you can share?

No problem:
Repository: https://github.com/streetsidesoftware/cspell
Steps:

Setup
npm install
npm run build
npm test

open Workspace: cspell.code-workspace

open File: packages/cspell-lib/src/Settings/InDocSettings.test.ts

Pick Launch Profile: cspell-lib: Jest current-file or test: Jest current-file, both worked in the past.

Set a breakpoint on line 104:

F5

It stops on line 90:

Hm, both of those configurations work for me following your instructions

That is frustrating. Any way I can help debug it on my end?

I've encountered similar issue

Turns out it's the problem with tsconfig.json,
It need to have "sourceMap": true to work correctly

In this case "sourceMap": true has been set.

hi @Jason3S I don't know if you have solved this, but if you haven't and this sounds ridiculous try renaming your project root folder.  For me it has something to do with the state of that folder and VS Code.  If I rename the folder back then it breaks debugging again.  This was so frustrating it took me hours to solve...  still ❤ VS Code though!
@connor4312 is there a way to completely remove saved state from VS Code?  I had cleared out the directory C:\Users\brian\AppData\Local\Programs\Microsoft VS Code and OP is on Mac. Thanks.


pythonPackages.bjoern: 2.2.3 -> 3.0.1

Motivation for this change
Upstream has addressed issues noted in https://github.com/NixOS/nixpkgs/pull/62055 and made a new release. This should supersede https://github.com/NixOS/nixpkgs/pull/62055 and https://github.com/NixOS/nixpkgs/pull/61887.
Test execution seems a little unusual/hit-and-miss for me on macos (tested 10.13), but the exact same problem appears to exist with 2.2.3.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[ ] NixOS
[x] macOS
[x] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Assured whether relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

@GrahamcOfBorg build pythonPackages.bjoern python3Packages.bjoern

Thanks @risicle!


Unable to use ssh key without passphrase

In some cases a keyfile can be generated without a passphrase being used.
Keys that have this are unable to be used it seems.
Would it be possible to allow the value false for the passphrase setting to skip decrypting the key?
Expected Behavior
Set up configuration file with "privateKeyPath" to absolute path to key file
Set configuration "passphrase" to null or false
Actual Behavior
Setting the "passphrase" to true prompts for a passphrase and connection stalls.
Specifications

Version: 1.20.0
Platform: macOS 10.13.3

Just don't set passphrase!


separated types from executable code and modifying the build.mjs file accordingly

This PR separates type definitions from executable code and updates the build script - build.mjs accordingly. This improves code organization, scalability, and facilitates code reuse. The updated build process ensures the accurate generation of the declaration file. After running the modified file no changes were made to build files which means it functions in the same way.
This makes it easier to locate types also and make changes
also using the type keyword promotes better documentation, easier refactoring, and overall improved code quality.

Hi.. @Sadaf-A, Thanks so much for this PR, this is a great improvement to the codebase :taa:

Always a pleasure


Implement List Details page

Overview
This PR creates a paginated table which it uses to display a set of facility lists items for a specific list as depicted below.
Connects #190
Demo

Testing

get this branch, then ./scripts/server and visit http://localhost:6543
login to your account and upload a list from one of the existing fixtures in the repository
in the VM, run ./scripts/manage batch_process parse --list-id <YOUR-LIST-ID> where <YOUR-LIST-ID> is the ID for the list you just uploaded
visit http://localhost:6543/lists and click on your list to select it
verify that you visit the details page and that your list items are displayed with proper values in each cell for ones that have been parsed
try the pagination and row count changes and verify that they work and that they update the URL state correctly -- you should be able to visit a paginated link directly and get the proper set of results

Looking at this now

For my future benefit: the actual command to parse an uploaded list is:
./scripts/manage batch_process --action parse --list-id <ID>

saw an invalid prop type warning in the console.

fixed in e3626ef72c311b416d1175a2f117e225b2017e8a

d0f1ca0344d93627eefa23916ba8427a7e6fbf15 moves the page and rows per page arguments into querystring parameters instead of URL paths. I also added a utility function for parsing the querystring & handling bad inputs, along with a set of tests to check that it works.
@jwalgran this is ready for another look!

Looking at this now

Thanks for your help with this! I added a commit to include a comment in models.py indicating that the FacilityListItem's STATUS_CHOICES tuple needs to be keep in sync with the similar constant in the client's constants.js file, then squashed everything down to one commit. Will merge once the tests pass on CI!


Commit of DMoramarco

I added my name to Example.txt

Good job! :star2: :star2:  :chart_with_upwards_trend:
I close your pull request now. Please use the same procedure to submit your proposed assignment solutions for the upcoming sessions.


[storage] Object Spec and Status

https://kubernetes.io/docs/concepts/overview/working-with-objects/kubernetes-objects/

I think we move to keep configurable fields (i.e. user intent) in spec and system information i.e. read-only (FYI) fields in status. This allows clear ownership of fields - what user wants vs. what system delivered or what system wants user to know. A good example is how Kuberenetes leverages this categorization (more at https://kubernetes.io/docs/concepts/overview/working-with-objects/kubernetes-objects/0.
As an immediate benefit, this will allow us to keep some fields that user can benefit from but we are excluding them from object definitions because we think they should not user configurable (e.g. allocated fields such as MAC OUI of the NIC, or pcie bus/slot information vs. VF/PF in PCIE identifier).
Separating spec and status fields has other benefits too:

It can allow operationalize (by reading status fields, you don't need a separate get response, just fetching the object can tell you its status
It allows building (or leveraging) tools that can look at these objects generically e.g. help with backing up the intent and restoring information (upon failure, say)
This can allow for a clean separation and allow us to expose Status only objects that are useful to the user (no user intent)
Finally having Status doesn't mean we must have something in there, if there is no operational state of an object, there is no need to have its status.

Would love to hear others' opinions on this topic. I would happy to submit a PR with relevant status fields for storage objects to keep it concrete.

@jainvipin Sounds great - let's get the input and the output separated. I think that will help a lot with clarity.


Update installation.rst

Addresses https://github.com/nginx/unit/issues/1476 with installation instructions for Ubuntu 24.04 LTS.

Oh! All right, please ignore then, and merge the other :)


Add batch-wise random erasing support?

🚀 Feature

Motivation
The random erasing supported in torchvision now is implemented as image-wise. I need to use it after data loader collecting batches. But the current design cannot be used for a large batch because it is too slow to preprocess on CPU.
I use a for loop to process per-image in a batch, as shown below, but it is too slow:
for batch_of_imgs, labels in my_data_loader:
    # I need apply random erasing here, not in transforms of data loader
    # This for-loop is too slow!!!
    for i, img in enumerate(batch_of_imgs):
        batch_of_imgs[i] = RandomErasing(img)
    # train model as usual
    preds = model(batch_of_imgs, labels)

Pitch
If a batch-wise random erasing operation that could accelerate such preprocessing is available, it would be very helpful.

Alternatives
I've tried 2 alternatives:

Use multi-threading. This does not help due to python GIL.
Use multi-processing. This saves around 50% preprocessing time per-iteration at the beginning of training but gradually becomes as slow as single-processing one. It provides around <10% improvements from the whole training procedure but requires more resources for processing management, and tricky hacks to modify training code.

Additional context

The erasing procedure should be image-wise, not batch-wise. In other words, the erased region cannot be shared among images of same batch.
cc @SsnL @VitalyFedyunin @ejguan @fmassa @vfdev-5

This is supported already for Tensors:
import torch
from torchvision import transforms as T

random_erasing = T.RandomErasing(value=0, p=1.0)

x = torch.ones(4, 3, 44, 56)

x = random_erasing(x)

Perhaps you are passing PIL images and that's why it's slow?

This is supported already for Tensors:
import torch
from torchvision import transforms as T

random_erasing = T.RandomErasing(value=0, p=1.0)

x = torch.ones(4, 3, 44, 56)

x = random_erasing(x)

Perhaps you are passing PIL images and that's why it's slow?

I think he want to input a whole batch but cut out different areas for each image.

This is supported already for Tensors:
import torch
from torchvision import transforms as T

random_erasing = T.RandomErasing(value=0, p=1.0)

x = torch.ones(4, 3, 44, 56)

x = random_erasing(x)

Perhaps you are passing PIL images and that's why it's slow?

I think he want to input a whole batch but cut out different areas for each image.

Yes, that's exactly what I want.

This is supported already for Tensors:
import torch
from torchvision import transforms as T

random_erasing = T.RandomErasing(value=0, p=1.0)

x = torch.ones(4, 3, 44, 56)

x = random_erasing(x)

Perhaps you are passing PIL images and that's why it's slow?
Edit:

the erased region cannot be shared among images of same batch.

I missed this part. Yes in this case it's not supported as all the images will have the same patch missing.

Interestingly, I find that on my Ubuntu 18.04 python3.7.6, your code does not work.

Maybe I need to update my pytorch and torchvision?

@ruiyuanlu yes, tensor support was added since 0.8.X for torchvision.

I am using version 0.8.2 and I still have this issue. To further clarify, I am able to apply the random erasing augmentation to a batched image tensor, however, the issue is that the erased region is the same for each image in the batch. We would like an option for the erased region to be random independently for each image in the batch (hence "batch-wise random").

@timothybrooks Hi! I'm just curious, what is your use case that need this feature?

@timothybrooks Hi! I'm just curious, what is your use case that need this feature?
If it is convenient to tell.

In my case, some statistical information I need (usually before batch-wise random erasing) requires a batched input rather than one single image.  Yet using a python-for-loop to apply image-wise random erasing for a batch is too slow (especially when batch size is large). That's why a batch-wise random erasing is necessary.

@timothybrooks Hi! I'm just curious, what is your use case that need this feature?
If it is convenient to tell.

In my case, some statistical information I need (usually before batch-wise random erasing) requires a batched input rather than one single image.  Yet using a python-for-loop to apply image-wise random erasing for a batch is too slow (especially when batch size is large). That's why a batch-wise random erasing is necessary.

I see.  Thanks for the explanation!

Hi @voldemortX,
My application is for differentiable data augmentation used on both real images and generated images during the training of GANs. (https://arxiv.org/abs/2006.10738, https://arxiv.org/abs/2006.06676). Public implementations for both of these papers use their own custom data augmentation implementations. It would be great to instead use the torchvision augmentations, which would ease implementation, open the door to using a wider variety of augmentations, and provide finer grained control over extents and probabilities of augmentations.
It would perhaps be best to make this a separate broader github issue, since I desire independence across instances in a batch for all types of augmentations, not just random erasing. Do you have any thoughts on supporting this broader change?

@timothybrooks @ruiyuanlu Given these papers and use cases, batch-wise random do seem rather useful to support fast differentiable transforms & statistical information gathering.
If implemented more broadly (consider only tensor-supported ops), it should be possible for linear transforms (transforms represented by matrix multiplications, thus we can stack matrices), and it is also done with random erasing & inplace color jittering (https://github.com/mit-han-lab/data-efficient-gans/blob/master/DiffAugment_pytorch.py). For transforms such as resizing, I don't see a straight-forward method, but resize (interpolate) is also differentiable in nature.
However, I think supporting batch-wise random might constitute too much change to the torchvision transform design. Since right now transforms.py builds on functional.py (which is deterministic).
cc @vfdev-5 @datumbox. Maybe you guys can pitch in here to give us some further insight?

Thanks for the summary and ideas @voldemortX. One option for spatial transformations would be to leverage F.affine_grid() and F.grid_sample(). I have a resizing and translation augmentation implemented this way which I could share as an example.
Note that for common GAN regularization methods to work with F.grid_sample() will require implementation of second order derivatives (see issue #34704). NVIDIA provides code for this here: https://github.com/NVlabs/stylegan2-ada-pytorch/blob/main/torch_utils/ops/grid_sample_gradfix.py


Premiumize Working, but not Adding Files to /shows or /movies

Due to the recent RD shutdown, I purchased Premiumize. I removed RD and added Premiumize using my API, as well as Jackett for extra sources.
pd_zurg appears to be processing the requests correctly, as when I add a movie to my watchlist on Plex, I see the request get processed in docker, and when I log into Premiumize I see the movie get downloaded.
However, there appears to be an issue with it being added to the rclone /docker/pd_zurg/mnt/rd/movies as it's not showing up in there or appearing on my Plex library.
I set up my server initially using this guide:
https://docs.google.com/document/d/1wGzoV11vG2jiSiKm_EoShrcig70pWYPDYiYbAXT5jRQ/edit?tab=t.0#heading=h.nu4h35dxqc4q
Is there anything need to get my Premiumize to work with pd_zurg? Thank you for all the help!
Here is my compose:
 ## Optionally, specify a specific version of pd_zurg
   version: "3.8"

services:
  pd_zurg:
    container_name: pd_zurg
    image: iampuid0/pd_zurg:latest
    network_mode: host
    # image: iampuid0/pd_zurg:2.0.0
    stdin_open: true # docker run -i
    tty: true        # docker run -t
    volumes:
      ## Location of configuration files. If a Zurg config.yml and/or Zurg app is placed here, it will be used to override the default configuration and/or app used at startup.
      - /docker/pd_zurg/config:/config
      ## Location for logs
      - /docker/pd_zurg/log:/log
      ## Location for rclone cache if enabled
      - /docker/pd_zurg/cache:/cache
      ## Location for Zurg RealDebrid active configuration
      - /docker/pd_zurg/RD:/zurg/RD
      ## Location for Zurg AllDebrid active configuration -- when supported by Zurg
      - /docker/pd_zurg/AD:/zurg/AD
      ## Location for rclone mount to host
      - /docker/pd_zurg/mnt:/data:shared
    environment:
      - TZ=
      ## Zurg Required Settings
      - ZURG_ENABLED=true
      - RD_API_KEY=FP4V5FWW64CSWXSSRFCBWATRUSVLWKLEUSZ36SWYG6BYA2GH452A
      ## Zurg Optional Settings
     # - ZURG_LOG_LEVEL=DEBUG
     # - ZURG_VERSION=v0.9.2-hotfix.4
      - ZURG_UPDATE=true
      - PLEX_REFRESH=true
      - PLEX_MOUNT_DIR=/docker/pd_zurg/mnt/rd
     # - ZURG_USER=
     # - ZURG_PASS=
      - ZURG_PORT=9999
      ## Rclone Required Settings
      - RCLONE_MOUNT_NAME=rd
      ## Rclone Optional Settings - See rclone docs for full list
     # - NFS_ENABLED=true
     # - NFS_PORT=8000
     # - RCLONE_LOG_LEVEL=DEBUG
     # - RCLONE_CACHE_DIR=/cache
     # - RCLONE_DIR_CACHE_TIME=10s
     # - RCLONE_VFS_CACHE_MODE=full
     # - RCLONE_VFS_CACHE_MAX_SIZE=100G
     # - RCLONE_ATTR_TIMEOUT=8700h
     # - RCLONE_BUFFER_SIZE=32M
     # - RCLONE_VFS_CACHE_MAX_AGE=4h
     # - RCLONE_VFS_READ_CHUNK_SIZE=32M
     # - RCLONE_VFS_READ_CHUNK_SIZE_LIMIT=1G
     # - RCLONE_TRANSFERS=8
      ## Plex Debrid Required Settings
      - PD_ENABLED=true
      ## To utilize plex_debrid with Plex, the following environment variables are required
      - PLEX_USER=cameronvahe
      - PLEX_TOKEN=itskN2xZwLWRFfN49tzg
      - PLEX_ADDRESS=http://localhost:32400
      ## To utilize plex_debrid with Jellyfin, the following environment variables are required - Note that plex_debrid will require addtional setup befor use with Jellyfin
     # - JF_ADDRESS
     # - JF_API_KEY
      ## Plex Debrid Optional Settings
      - PD_UPDATE=true
     # - SHOW_MENU=false
      - SEERR_API_KEY=MTczMjI4ODcxNzEzNzY5OTNlYzU2LTJiZWMtNGU3Ny04MmRmLTg5ODRmNWQyODBkYg==
      - SEERR_ADDRESS=http://localhost:5055
      ## Special Features
     # - AUTO_UPDATE_INTERVAL=12
     # - DUPLICATE_CLEANUP=true
     # - CLEANUP_INTERVAL=1
     # - PDZURG_LOG_LEVEL=DEBUG
     # - PDZURG_LOG_COUNT=2
    # Example to attach to gluetun vpn container if realdebrid blocks IP address
    # network_mode: container:gluetun
    devices:
      - /dev/fuse:/dev/fuse:rwm
    cap_add:
      - SYS_ADMIN
    security_opt:
      - apparmor:unconfined
      - no-new-privileges

Just tried with AllDebrid free trial. Same thing. Shows up on AD web page but nothing in /movies or /shows

Wondering if this is related
https://www.reddit.com/r/debridmediamanager/comments/1e4lb6d/how_to_get_zurg_rclone_to_work_with_alldebrid/

Okay, I've recreated pd_zurg this time passing the AD_API_KEY instead of RD so it starts with AD instance as opposed to RD.
Looks like it's failing. I created an API key on AD site and added it to AD_API_KEY=keyhere on my compose file but it looks like it's not accepting it .Any idea? TY!
Nov 22, 2024 16:52:16 - INFO - Setting up Zurg Nov 22, 2024 16:52:16 - INFO - Setting up Zurg w/ AllDebrid instance in directory: /zurg/AD/ Nov 22, 2024 16:52:16 - INFO - Found Zurg version v0.9.3-final in /zurg/AD/ Nov 22, 2024 16:52:16 - INFO - Preparing Zurg instance for AllDebrid Nov 22, 2024 16:52:16 - INFO - Using Zurg app found for AllDebrid in /zurg/AD/ Nov 22, 2024 16:52:16 - INFO - Using Zurg config found for AllDebrid in /zurg/AD/ Nov 22, 2024 16:52:16 - INFO - Zurg setup process complete Nov 22, 2024 16:52:16 - INFO - Automatic updates set to 24 hours for Zurg Nov 22, 2024 16:52:16 - INFO - Checking for available Zurg updates Nov 22, 2024 16:52:16 - INFO - Fetching latest zurg-testing release. Nov 22, 2024 16:52:16 - INFO - zurg-testing latest release: v0.9.3-final Nov 22, 2024 16:52:16 - INFO - Zurg current version: v0.9.3-final Nov 22, 2024 16:52:16 - INFO - Zurg is already up to date. Nov 22, 2024 16:52:16 - INFO - Starting Zurg w/ AllDebrid Nov 22, 2024 16:52:16 - INFO - Checking rclone flags Nov 22, 2024 16:52:16 - INFO - Configuring the rclone mount name to "ad" Nov 22, 2024 16:52:16 - INFO - Zurg w/ AllDebrid subprocess: Logging to logs/zurg-2024-11-22.log Nov 22, 2024 16:52:16 - INFO - Configuring rclone for ad Nov 22, 2024 16:52:16 - ERROR - cannot access local variable 'rd_port' where it is not associated with a value Nov 22, 2024 16:52:16 - INFO - Zurg w/ AllDebrid subprocess: 	zurg	Version: v0.9.3-final Nov 22, 2024 16:52:16 - INFO - Zurg w/ AllDebrid subprocess: 	zurg	GitCommit: 4179c2745b4fb22fcb37f36de27b3daa39f114f0 Nov 22, 2024 16:52:16 - INFO - Zurg w/ AllDebrid subprocess: 	zurg	BuiltAt: 2024-07-14T09:48:30 Nov 22, 2024 16:52:16 - INFO - Zurg w/ AllDebrid subprocess: 	zurg	Debug logging is enabled; if you are not debugging please set LOG_LEVEL=info in your environment Nov 22, 2024 16:52:16 - INFO - Zurg w/ AllDebrid subprocess: 	zurg	Starting server on [::]:9099 Nov 22, 2024 16:52:16 - ERROR - Zurg w/ AllDebrid subprocess: 	realdebrid	Error when executing the user information request: api response error: bad_token (status code: 401) (code: 8) Nov 22, 2024 16:52:16 - ERROR - Zurg w/ AllDebrid subprocess: 	zurg	Failed to get user information: api response error: bad_token (status code: 401) (code: 8) Nov 22, 2024 16:52:17 - ERROR - Zurg w/ AllDebrid subprocess: 	realdebrid	Error when executing the get torrents request: api response error: bad_token (status code: 401) (code: 8) Nov 22, 2024 16:52:17 - INFO - Zurg w/ AllDebrid subprocess: 2024-11-22T16:52:17.410Z	WARN	manager	Cannot get torrents: api response error: bad_token (status code: 401) (code: 8) Nov 22, 2024 16:52:18 - ERROR - Zurg w/ AllDebrid subprocess: 	realdebrid	Error when executing the get torrents request: api response error: bad_token (status code: 401) (code: 8) Nov 22, 2024 16:52:18 - ERROR - Zurg w/ AllDebrid subprocess: 	manager	Checksum API Error (GetActiveTorrents): api response error: bad_token (status code: 401) (code: 8) Nov 22, 2024 16:52:18 - INFO - Zurg w/ AllDebrid subprocess: 	manager	Starting periodic repair job Nov 22, 2024 16:52:18 - INFO - Zurg w/ AllDebrid subprocess: 	manager	Periodic repair started; searching for broken torrents Nov 22, 2024 16:52:18 - INFO - Zurg w/ AllDebrid subprocess: 	manager	Finished repairing 0 broken torrents Nov 22, 2024 16:52:18 - INFO - Zurg w/ AllDebrid subprocess: 	manager	Starting periodic refresh job

Zurg, which is in pd_zurg, only supports RealDebrid at the moment.

Understood, thanks!
Is there any current workaround for the Realdebrid shutdown? RD is throwing infringing link errors all around Zurg, so hopefully the dev might have some tricks up their sleeve

I believe the Zurg dev is working on updates for both RD and possibly adding additional debrid support. As for the errors, I have read that those can likely be ignored as items seem to still be added. Alternatively, you should be able to use other plex_debrid repos that have patches for the recent changes.
You would add the following to the compose environment section to use mercuryy-1337 fork of plex_debrid.
PD_REPO=mercuryy-1337,plex_debrid,main

Thanks for the info! I added that variable and rebuilt with compose to use that repo but I am still receiving infringing link errors for RealDebrid.
Has mercuryy reported any success using RD since the API shutdown?

I believe the Zurg dev is working on updates for both RD and possibly adding additional debrid support. As for the errors, I have read that those can likely be ignored as items seem to still be added. Alternatively, you should be able to use other plex_debrid repos that have patches for the recent changes.
You would add the following to the compose environment section to use mercuryy-1337 fork of plex_debrid.
PD_REPO=mercuryy-1337,plex_debrid,main

Incredible. I got it working.
Thank you!

I believe the Zurg dev is working on updates for both RD and possibly adding additional debrid support. As for the errors, I have read that those can likely be ignored as items seem to still be added. Alternatively, you should be able to use other plex_debrid repos that have patches for the recent changes.
You would add the following to the compose environment section to use mercuryy-1337 fork of plex_debrid.
PD_REPO=mercuryy-1337,plex_debrid,main

Incredible. I got it working.
Thank you!

Did you have to do anything besides just updating the repo?


Pass the read and open timeout options

Set the read_timeout and open_timeout options when performing OAuth requests.

There's probably a test you should update.

I don't believe there is a test for lib/hubspot/oauth.rb


Replace HashMap with Map interface

Addresses #179

/format

Ah, had it right the first time 😄 Will it work if I edit?

I already linked it manually so it shouldn't make a difference. I'll take a look and merge tomorrow


add error handling

Hi there, this is a small PR for adding the following features:

error treatments to request calls.
logger to log eventual errors.
decorator to retry when found an error.

Cheers,
Vinicius

Nicely done, thanks @vwoloszyn 😍