[WFCORE-307]: When Wildfly fails with JBAS015810: failed to resolve interface management, it should terminate.

Checking that one of the services for Management Interface is available at the end of the operation on boot.
Rollbacking if this is not the case.
Jira: https://issues.jboss.org/browse/WFCORE-307

Linux Build 4102 outcome was FAILURE using a merge of de2da0597716c420607fbcca02e03f14f8160da0
Summary: Tests failed: 2 (2 new), passed: 3669, ignored: 55 Build time: 00:40:21
Failed tests
org.jboss.as.test.integration.domain.DefaultInterfaceOveridingDomainTestCase: java.lang.RuntimeException: Could not start container
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.awaitServers(DomainLifecycleUtil.java:449)
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.start(DomainLifecycleUtil.java:251)
	at org.jboss.as.test.integration.domain.DefaultInterfaceOveridingDomainTestCase.setupDomain(DefaultInterfaceOveridingDomainTestCase.java:77)
------- Stdout: -------
[Host Controller]  [0m [33m07:35:18,261 WARN  [org.jboss.as.host.controller] (management task-5) WFLYHC0015: Connection to remote host-controller closed. Trying to reconnect. [0m
[Host Controller]  [33m [0m [0m07:35:18,263 INFO  [org.jboss.as.host.controller] (Host Controller Service Threads - 10) WFLYHC0150: Trying to reconnect to master host controller. [0m
/opt/buildAgent/work/734840e5f962fb3f/testsuite/domain/target/test-classes/domain-configs/domain-default-interface.xml
/opt/buildAgent/work/734840e5f962fb3f/testsuite/domain/target/test-classes/host-configs/host-default-interface.xml
 [0m07:35:19,567 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
 [0m [0m07:35:19,733 INFO  [org.jboss.as.process.Host Controller.status] (main) WFLYPC0018: Starting process 'Host Controller'
 [0m[Host Controller]  [0m07:35:20,334 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final [0m
[Host Controller]  [0m [0m07:35:20,534 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final [0m
[Host Controller]  [0m [0m07:35:20,614 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: WildFly Core 3.0.0.Alpha4-SNAPSHOT "Kenny" starting [0m
[Host Controller]  [0m [0m07:35:21,311 INFO  [org.xnio] (MSC service thread 1-1) XNIO version 3.4.0.Beta2 [0m
[Host Controller]  [0m [0m07:35:21,332 INFO  [org.xnio.nio] (MSC service thread 1-1) XNIO NIO Implementation Version 3.4.0.Beta2 [0m
[Host Controller]  [0m [0m07:35:21,390 INFO  [org.jboss.remoting] (MSC service thread 1-1) JBoss Remoting version 4.0.21.Final [0m
[Host Controller]  [0m [0m07:35:21,433 INFO  [org.jboss.as.remoting] (MSC service thread 1-6) WFLYRMT0001: Listening on [::1]:9999 [0m
[Host Controller]  [0m [31m07:35:21,459 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0034: Host Controller boot has failed in an unrecoverable manner; exiting. See previous messages for details. [0m
[Host Controller]  [31m [0m [31m07:35:21,461 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0178: Aborting with exit code 99 [0m
[Host Controller]  [31m [0m [0m07:35:21,478 INFO  [org.jboss.as] (MSC service thread 1-2) WFLYSRV0050: WildFly Core 3.0.0.Alpha4-SNAPSHOT "Kenny" stopped in 8ms [0m
[Host Controller]  [0m [0m
 [0m07:35:21,807 INFO  [org.jboss.as.process.Host Controller.status] (reaper for Host Controller) WFLYPC0011: Process 'Host Controller' finished with an exit status of 99
 [0m [0m07:35:21,810 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0017: Shutting down process controller
 [0m [0m07:35:21,811 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0016: All processes finished; exiting
 [0m

org.jboss.as.test.integration.domain.HTTPSManagementInterfaceTestCase: java.lang.RuntimeException: java.lang.RuntimeException: Could not start container
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.awaitHostController(DomainLifecycleUtil.java:466)
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.start(DomainLifecycleUtil.java:256)
	at org.jboss.as.test.integration.domain.management.util.DomainTestSupport.start(DomainTestSupport.java:366)
	at org.jboss.as.test.integration.domain.management.util.DomainTestSupport.createAndStartSupport(DomainTestSupport.java:98)
	at org.jboss.as.test.integration.domain.HTTPSManagementInterfaceTestCase.setupDomain(HTTPSManagementInterfaceTestCase.java:107)
------- Stdout: -------
[Host Controller]  [0m [0m07:36:18,203 INFO  [org.jboss.as.domain.controller] (management task-6) WFLYHC0026: Unregistered remote slave host "slave" [0m
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file /opt/buildAgent/work/734840e5f962fb3f/testsuite/domain/target/https-mgmt-workdir/server.keystore
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file /opt/buildAgent/work/734840e5f962fb3f/testsuite/domain/target/https-mgmt-workdir/server.truststore
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file /opt/buildAgent/work/734840e5f962fb3f/testsuite/domain/target/https-mgmt-workdir/server.crt
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file /opt/buildAgent/work/734840e5f962fb3f/testsuite/domain/target/https-mgmt-workdir/client.keystore
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file /opt/buildAgent/work/734840e5f962fb3f/testsuite/domain/target/https-mgmt-workdir/client.truststore
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file /opt/buildAgent/work/734840e5f962fb3f/testsuite/domain/target/https-mgmt-workdir/client.crt
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file /opt/buildAgent/work/734840e5f962fb3f/testsuite/domain/target/https-mgmt-workdir/untrusted.keystore
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file /opt/buildAgent/work/734840e5f962fb3f/testsuite/domain/target/https-mgmt-workdir/untrusted.crt
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Key material created in /opt/buildAgent/work/734840e5f962fb3f/testsuite/domain/target/https-mgmt-workdir
 [0m07:36:19,665 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
 [0m [0m07:36:19,788 INFO  [org.jboss.as.process.Host Controller.status] (main) WFLYPC0018: Starting process 'Host Controller'
 [0m[Host Controller]  [0m07:36:20,232 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final [0m
[Host Controller]  [0m [0m07:36:20,388 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final [0m
[Host Controller]  [0m [0m07:36:20,439 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: WildFly Core 3.0.0.Alpha4-SNAPSHOT "Kenny" starting [0m
[Host Controller]  [0m [0m07:36:20,990 INFO  [org.xnio] (MSC service thread 1-4) XNIO version 3.4.0.Beta2 [0m
[Host Controller]  [0m [0m07:36:21,009 INFO  [org.xnio.nio] (MSC service thread 1-4) XNIO NIO Implementation Version 3.4.0.Beta2 [0m
[Host Controller]  [0m [0m07:36:21,041 INFO  [org.jboss.remoting] (MSC service thread 1-4) JBoss Remoting version 4.0.21.Final [0m
[Host Controller]  [0m [0m07:36:21,063 INFO  [org.jboss.as.remoting] (MSC service thread 1-4) WFLYRMT0001: Listening on [::1]:9999 [0m
[Host Controller]  [0m [31m07:36:21,078 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0034: Host Controller boot has failed in an unrecoverable manner; exiting. See previous messages for details. [0m
[Host Controller]  [31m [0m [31m07:36:21,080 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0178: Aborting with exit code 99 [0m
[Host Controller]  [31m [0m [0m07:36:21,093 INFO  [org.jboss.as] (MSC service thread 1-6) WFLYSRV0050: WildFly Core 3.0.0.Alpha4-SNAPSHOT "Kenny" stopped in 5ms [0m
[Host Controller]  [0m [0m
 [0m07:36:21,413 INFO  [org.jboss.as.process.Host Controller.status] (reaper for Host Controller) WFLYPC0011: Process 'Host Controller' finished with an exit status of 99
 [0m [0m07:36:21,414 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0017: Shutting down process controller
 [0m [0m07:36:21,415 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0016: All processes finished; exiting
 [0mjava.lang.NullPointerException: null
	at org.jboss.as.test.integration.domain.HTTPSManagementInterfaceTestCase.tearDownDomain(HTTPSManagementInterfaceTestCase.java:115)

Windows Build 3462 outcome was FAILURE using a merge of de2da0597716c420607fbcca02e03f14f8160da0
Summary: Tests failed: 2 (2 new), passed: 3669, ignored: 55 Build time: 00:52:35
Failed tests
org.jboss.as.test.integration.domain.DefaultInterfaceOveridingDomainTestCase: java.lang.RuntimeException: Could not start container
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.awaitServers(DomainLifecycleUtil.java:449)
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.start(DomainLifecycleUtil.java:251)
	at org.jboss.as.test.integration.domain.DefaultInterfaceOveridingDomainTestCase.setupDomain(DefaultInterfaceOveridingDomainTestCase.java:77)
------- Stdout: -------
C:\BuildAgent\work\4c983eca15c0017f\testsuite\domain\target\test-classes\domain-configs\domain-default-interface.xml
C:\BuildAgent\work\4c983eca15c0017f\testsuite\domain\target\test-classes\host-configs\host-default-interface.xml
15:32:12,509 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
15:32:12,732 INFO  [org.jboss.as.process.Host Controller.status] (main) WFLYPC0018: Starting process 'Host Controller'
[Host Controller] 15:32:13,606 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
[Host Controller] 15:32:13,995 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
[Host Controller] 15:32:14,084 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: WildFly Core 3.0.0.Alpha4-SNAPSHOT "Kenny" starting
[Host Controller] 15:32:14,670 INFO  [org.xnio] (MSC service thread 1-6) XNIO version 3.4.0.Beta2
[Host Controller] 15:32:14,676 INFO  [org.xnio.nio] (MSC service thread 1-6) XNIO NIO Implementation Version 3.4.0.Beta2
[Host Controller] 15:32:14,732 INFO  [org.jboss.remoting] (MSC service thread 1-6) JBoss Remoting version 4.0.21.Final
[Host Controller] 15:32:14,763 INFO  [org.jboss.as.remoting] (MSC service thread 1-1) WFLYRMT0001: Listening on [::1]:9999
[Host Controller] 15:32:14,777 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0034: Host Controller boot has failed in an unrecoverable manner; exiting. See previous messages for details.
[Host Controller] 15:32:14,778 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0178: Aborting with exit code 99
[Host Controller] 15:32:14,784 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0050: WildFly Core 3.0.0.Alpha4-SNAPSHOT "Kenny" stopped in 2ms
15:32:15,125 INFO  [org.jboss.as.process.Host Controller.status] (reaper for Host Controller) WFLYPC0011: Process 'Host Controller' finished with an exit status of 99
15:32:15,127 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0017: Shutting down process controller
15:32:15,127 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0016: All processes finished; exiting

org.jboss.as.test.integration.domain.HTTPSManagementInterfaceTestCase: java.lang.RuntimeException: java.lang.RuntimeException: Could not start container
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.awaitHostController(DomainLifecycleUtil.java:466)
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.start(DomainLifecycleUtil.java:256)
	at org.jboss.as.test.integration.domain.management.util.DomainTestSupport.start(DomainTestSupport.java:366)
	at org.jboss.as.test.integration.domain.management.util.DomainTestSupport.createAndStartSupport(DomainTestSupport.java:98)
	at org.jboss.as.test.integration.domain.HTTPSManagementInterfaceTestCase.setupDomain(HTTPSManagementInterfaceTestCase.java:107)
------- Stdout: -------
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file C:\BuildAgent\work\4c983eca15c0017f\testsuite\domain\target\https-mgmt-workdir\server.keystore
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file C:\BuildAgent\work\4c983eca15c0017f\testsuite\domain\target\https-mgmt-workdir\server.truststore
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file C:\BuildAgent\work\4c983eca15c0017f\testsuite\domain\target\https-mgmt-workdir\server.crt
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file C:\BuildAgent\work\4c983eca15c0017f\testsuite\domain\target\https-mgmt-workdir\client.keystore
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file C:\BuildAgent\work\4c983eca15c0017f\testsuite\domain\target\https-mgmt-workdir\client.truststore
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file C:\BuildAgent\work\4c983eca15c0017f\testsuite\domain\target\https-mgmt-workdir\client.crt
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file C:\BuildAgent\work\4c983eca15c0017f\testsuite\domain\target\https-mgmt-workdir\untrusted.keystore
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Creating test file C:\BuildAgent\work\4c983eca15c0017f\testsuite\domain\target\https-mgmt-workdir\untrusted.crt
INFO  [org.jboss.as.test.integration.security.common.CoreUtils] Key material created in C:\BuildAgent\work\4c983eca15c0017f\testsuite\domain\target\https-mgmt-workdir
15:32:42,134 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
15:32:42,393 INFO  [org.jboss.as.process.Host Controller.status] (main) WFLYPC0018: Starting process 'Host Controller'
[Host Controller] 15:32:43,243 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
[Host Controller] 15:32:43,596 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
[Host Controller] 15:32:43,696 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: WildFly Core 3.0.0.Alpha4-SNAPSHOT "Kenny" starting
[Host Controller] 15:32:44,485 INFO  [org.xnio] (MSC service thread 1-6) XNIO version 3.4.0.Beta2
[Host Controller] 15:32:44,490 INFO  [org.xnio.nio] (MSC service thread 1-6) XNIO NIO Implementation Version 3.4.0.Beta2
[Host Controller] 15:32:44,533 INFO  [org.jboss.remoting] (MSC service thread 1-6) JBoss Remoting version 4.0.21.Final
[Host Controller] 15:32:44,554 INFO  [org.jboss.as.remoting] (MSC service thread 1-6) WFLYRMT0001: Listening on [::1]:9999
[Host Controller] 15:32:44,565 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0034: Host Controller boot has failed in an unrecoverable manner; exiting. See previous messages for details.
[Host Controller] 15:32:44,566 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0178: Aborting with exit code 99
[Host Controller] 15:32:44,573 INFO  [org.jboss.as] (MSC service thread 1-1) WFLYSRV0050: WildFly Core 3.0.0.Alpha4-SNAPSHOT "Kenny" stopped in 3ms
15:32:44,925 INFO  [org.jboss.as.process.Host Controller.status] (reaper for Host Controller) WFLYPC0011: Process 'Host Controller' finished with an exit status of 99
15:32:44,929 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0017: Shutting down process controller
15:32:44,930 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0016: All processes finished; exitingjava.lang.NullPointerException: null
	at org.jboss.as.test.integration.domain.HTTPSManagementInterfaceTestCase.tearDownDomain(HTTPSManagementInterfaceTestCase.java:115)

Core - Full Integration Build 3094 outcome was FAILURE using a merge of de2da0597716c420607fbcca02e03f14f8160da0
Summary: Tests failed: 2 (2 new), passed: 3396, ignored: 193 Build time: 00:58:57
Failed tests
org.jboss.as.test.integration.domain.DefaultConfigSmokeTestCase.testMasterAndSlave: java.lang.RuntimeException: Could not start container
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.awaitServers(DomainLifecycleUtil.java:449)
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.start(DomainLifecycleUtil.java:251)
	at org.jboss.as.test.integration.domain.DefaultConfigSmokeTestCase.testMasterAndSlave(DefaultConfigSmokeTestCase.java:86)
------- Stdout: -------
 [0m07:58:37,960 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
 [0m [0m07:58:38,081 INFO  [org.jboss.as.process.Host Controller.status] (main) WFLYPC0018: Starting process 'Host Controller'
 [0m[Host Controller]  [0m07:58:38,741 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final [0m
[Host Controller]  [0m [0m07:58:38,954 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final [0m
[Host Controller]  [0m [0m07:58:39,017 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) starting [0m
[Host Controller]  [0m [0m07:58:39,809 INFO  [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0003: Creating http management service using network interface (management) port (9990) securePort (-1) [0m
[Host Controller]  [0m [0m07:58:39,810 INFO  [org.xnio] (MSC service thread 1-8) XNIO version 3.4.0.Beta2 [0m
[Host Controller]  [0m [0m07:58:39,816 INFO  [org.xnio.nio] (MSC service thread 1-8) XNIO NIO Implementation Version 3.4.0.Beta2 [0m
[Host Controller]  [0m [0m07:58:39,855 INFO  [org.jboss.remoting] (MSC service thread 1-8) JBoss Remoting version 4.0.21.Final [0m
[Host Controller]  [0m [33m07:58:39,869 WARN  [org.jboss.as.domain.management.security] (MSC service thread 1-2) WFLYDM0111: Keystore /opt/buildAgent/work/29472398f1ae6497/full/testsuite/domain/target/domains/DefaultConfigSmokeTestCase/master/configuration/application.keystore not found, it will be auto generated on first use with a self signed certificate for host localhost [0m
[Host Controller]  [33m [0m [0m07:58:39,922 INFO  [org.jboss.as.remoting] (MSC service thread 1-5) WFLYRMT0001: Listening on [::1]:9999 [0m
[Host Controller]  [0m [0m07:58:41,449 INFO  [org.jboss.as] (Controller Boot Thread) WFLYSRV0060: Http management interface listening on http://[::1]:9990/management [0m
[Host Controller]  [0m [0m07:58:41,450 INFO  [org.jboss.as] (Controller Boot Thread) WFLYSRV0051: Admin console listening on http://[::1]:9990 [0m
[Host Controller]  [0m [0m07:58:41,450 INFO  [org.jboss.as] (Controller Boot Thread) WFLYSRV0025: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) (Host Controller) started in 3187ms - Started 55 of 56 services (18 services are lazy, passive or on-demand) [0m
 [0m07:58:42,268 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
 [0m [0m07:58:42,385 INFO  [org.jboss.as.process.Host Controller.status] (main) WFLYPC0018: Starting process 'Host Controller'
 [0m[Host Controller]  [0m07:58:43,051 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final [0m
[Host Controller]  [0m [0m07:58:43,249 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final [0m
[Host Controller]  [0m [0m07:58:43,309 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) starting [0m
[Host Controller]  [0m [0m07:58:44,350 INFO  [org.xnio] (MSC service thread 1-5) XNIO version 3.4.0.Beta2 [0m
[Host Controller]  [0m [0m07:58:44,365 INFO  [org.xnio.nio] (MSC service thread 1-5) XNIO NIO Implementation Version 3.4.0.Beta2 [0m
[Host Controller]  [0m [33m07:58:44,421 WARN  [org.jboss.as.domain.management.security] (MSC service thread 1-2) WFLYDM0111: Keystore /opt/buildAgent/work/29472398f1ae6497/full/testsuite/domain/target/domains/DefaultConfigSmokeTestCase/slave/configuration/application.keystore not found, it will be auto generated on first use with a self signed certificate for host localhost [0m
[Host Controller]  [33m [0m [0m07:58:44,431 INFO  [org.jboss.remoting] (MSC service thread 1-8) JBoss Remoting version 4.0.21.Final [0m
[Host Controller]  [0m [0m07:58:44,456 INFO  [org.jboss.as.remoting] (MSC service thread 1-7) WFLYRMT0001: Listening on [::1]:19999 [0m
[Host Controller]  [0m [31m07:58:44,496 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0034: Host Controller boot has failed in an unrecoverable manner; exiting. See previous messages for details. [0m
[Host Controller]  [31m [0m [31m07:58:44,497 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0178: Aborting with exit code 99 [0m
[Host Controller]  [31m [0m [0m07:58:44,509 INFO  [org.jboss.as] (MSC service thread 1-2) WFLYSRV0050: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) stopped in 3ms [0m
[Host Controller]  [0m [0m
 [0m07:58:44,838 INFO  [org.jboss.as.process.Host Controller.status] (reaper for Host Controller) WFLYPC0011: Process 'Host Controller' finished with an exit status of 99
 [0m [0m07:58:44,840 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0017: Shutting down process controller
 [0m [0m07:58:44,842 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0016: All processes finished; exiting
 [0m

org.jboss.as.test.integration.domain.OrderedChildResourcesTestCase.testOrderedChildResources: java.lang.RuntimeException: Could not start container
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.awaitServers(DomainLifecycleUtil.java:449)
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.start(DomainLifecycleUtil.java:251)
	at org.jboss.as.test.integration.domain.OrderedChildResourcesTestCase.testOrderedChildResources(OrderedChildResourcesTestCase.java:69)
------- Stdout: -------
[Host Controller]  [0m [0m08:00:19,211 INFO  [org.jboss.as.domain.controller] (management task-4) WFLYHC0026: Unregistered remote slave host "slave" [0m
 [0m08:00:21,492 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
 [0m [0m08:00:21,819 INFO  [org.jboss.as.process.Host Controller.status] (main) WFLYPC0018: Starting process 'Host Controller'
 [0m[Host Controller]  [0m08:00:22,823 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final [0m
[Host Controller]  [0m [0m08:00:23,067 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final [0m
[Host Controller]  [0m [0m08:00:23,155 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) starting [0m
[Host Controller]  [0m [0m08:00:24,212 INFO  [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0003: Creating http management service using network interface (management) port (9990) securePort (-1) [0m
[Host Controller]  [0m [0m08:00:24,215 INFO  [org.xnio] (MSC service thread 1-7) XNIO version 3.4.0.Beta2 [0m
[Host Controller]  [0m [0m08:00:24,230 INFO  [org.xnio.nio] (MSC service thread 1-7) XNIO NIO Implementation Version 3.4.0.Beta2 [0m
[Host Controller]  [0m [0m08:00:24,301 INFO  [org.jboss.remoting] (MSC service thread 1-7) JBoss Remoting version 4.0.21.Final [0m
[Host Controller]  [0m [33m08:00:24,315 WARN  [org.jboss.as.domain.management.security] (MSC service thread 1-5) WFLYDM0111: Keystore /opt/buildAgent/work/29472398f1ae6497/full/testsuite/domain/target/domains/OrderedChildResourcesTestCase/master/configuration/application.keystore not found, it will be auto generated on first use with a self signed certificate for host localhost [0m
[Host Controller]  [33m [0m [0m08:00:24,345 INFO  [org.jboss.as.remoting] (MSC service thread 1-3) WFLYRMT0001: Listening on [::1]:9999 [0m
[Host Controller]  [0m [0m08:00:25,785 INFO  [org.jboss.as] (Controller Boot Thread) WFLYSRV0060: Http management interface listening on http://[::1]:9990/management [0m
[Host Controller]  [0m [0m08:00:25,785 INFO  [org.jboss.as] (Controller Boot Thread) WFLYSRV0051: Admin console listening on http://[::1]:9990 [0m
[Host Controller]  [0m [0m08:00:25,786 INFO  [org.jboss.as] (Controller Boot Thread) WFLYSRV0025: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) (Host Controller) started in 3824ms - Started 55 of 56 services (18 services are lazy, passive or on-demand) [0m
 [0m08:00:26,819 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
 [0m [0m08:00:26,974 INFO  [org.jboss.as.process.Host Controller.status] (main) WFLYPC0018: Starting process 'Host Controller'
 [0m[Host Controller]  [0m08:00:27,621 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final [0m
[Host Controller]  [0m [0m08:00:27,793 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final [0m
[Host Controller]  [0m [0m08:00:27,851 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) starting [0m
[Host Controller]  [0m [0m08:00:28,834 INFO  [org.xnio] (MSC service thread 1-3) XNIO version 3.4.0.Beta2 [0m
[Host Controller]  [0m [0m08:00:28,850 INFO  [org.xnio.nio] (MSC service thread 1-3) XNIO NIO Implementation Version 3.4.0.Beta2 [0m
[Host Controller]  [0m [33m08:00:28,902 WARN  [org.jboss.as.domain.management.security] (MSC service thread 1-1) WFLYDM0111: Keystore /opt/buildAgent/work/29472398f1ae6497/full/testsuite/domain/target/domains/OrderedChildResourcesTestCase/slave/configuration/application.keystore not found, it will be auto generated on first use with a self signed certificate for host localhost [0m
[Host Controller]  [33m [0m [0m08:00:28,918 INFO  [org.jboss.remoting] (MSC service thread 1-3) JBoss Remoting version 4.0.21.Final [0m
[Host Controller]  [0m [0m08:00:28,941 INFO  [org.jboss.as.remoting] (MSC service thread 1-3) WFLYRMT0001: Listening on [::1]:19999 [0m
[Host Controller]  [0m [31m08:00:28,981 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0034: Host Controller boot has failed in an unrecoverable manner; exiting. See previous messages for details. [0m
[Host Controller]  [31m [0m [31m08:00:28,983 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0178: Aborting with exit code 99 [0m
[Host Controller]  [31m [0m [0m08:00:28,992 INFO  [org.jboss.as] (MSC service thread 1-5) WFLYSRV0050: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) stopped in 4ms [0m
[Host Controller]  [0m [0m
 [0m08:00:29,322 INFO  [org.jboss.as.process.Host Controller.status] (reaper for Host Controller) WFLYPC0011: Process 'Host Controller' finished with an exit status of 99
 [0m [0m08:00:29,325 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0017: Shutting down process controller
 [0m [0m08:00:29,326 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0016: All processes finished; exiting
 [0m

Full integration - Windows Build 1538 outcome was FAILURE using a merge of de2da0597716c420607fbcca02e03f14f8160da0
Summary: Tests failed: 2 (2 new), passed: 3379, ignored: 194 Build time: 01:18:17
Failed tests
org.jboss.as.test.integration.domain.DefaultConfigSmokeTestCase.testMasterAndSlave: java.lang.RuntimeException: Could not start container
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.awaitServers(DomainLifecycleUtil.java:449)
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.start(DomainLifecycleUtil.java:251)
	at org.jboss.as.test.integration.domain.DefaultConfigSmokeTestCase.testMasterAndSlave(DefaultConfigSmokeTestCase.java:86)
------- Stdout: -------
16:16:38,392 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
16:16:38,590 INFO  [org.jboss.as.process.Host Controller.status] (main) WFLYPC0018: Starting process 'Host Controller'
[Host Controller] 16:16:39,107 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
[Host Controller] 16:16:39,295 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
[Host Controller] 16:16:39,360 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) starting
[Host Controller] 16:16:40,012 INFO  [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0003: Creating http management service using network interface (management) port (9990) securePort (-1)
[Host Controller] 16:16:40,014 INFO  [org.xnio] (MSC service thread 1-3) XNIO version 3.4.0.Beta2
[Host Controller] 16:16:40,022 INFO  [org.xnio.nio] (MSC service thread 1-3) XNIO NIO Implementation Version 3.4.0.Beta2
[Host Controller] 16:16:40,084 WARN  [org.jboss.as.domain.management.security] (MSC service thread 1-6) WFLYDM0111: Keystore C:\BuildAgent\work\5768cf3a0bee5b47\full\testsuite\domain\target\domains\DefaultConfigSmokeTestCase\master\configuration\application.keystore not found, it will be auto generated on first use with a self signed certificate for host localhost
[Host Controller] 16:16:40,088 INFO  [org.jboss.remoting] (MSC service thread 1-3) JBoss Remoting version 4.0.21.Final
[Host Controller] 16:16:40,131 INFO  [org.jboss.as.remoting] (MSC service thread 1-3) WFLYRMT0001: Listening on [::1]:9999
[Host Controller] 16:16:41,646 INFO  [org.jboss.as] (Controller Boot Thread) WFLYSRV0060: Http management interface listening on http://[::1]:9990/management
[Host Controller] 16:16:41,646 INFO  [org.jboss.as] (Controller Boot Thread) WFLYSRV0051: Admin console listening on http://[::1]:9990
[Host Controller] 16:16:41,647 INFO  [org.jboss.as] (Controller Boot Thread) WFLYSRV0025: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) (Host Controller) started in 2916ms - Started 55 of 56 services (18 services are lazy, passive or on-demand)
16:16:42,720 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
16:16:43,082 INFO  [org.jboss.as.process.Host Controller.status] (main) WFLYPC0018: Starting process 'Host Controller'
[Host Controller] 16:16:43,745 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
[Host Controller] 16:16:44,071 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
[Host Controller] 16:16:44,129 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) starting
[Host Controller] 16:16:44,775 INFO  [org.xnio] (MSC service thread 1-1) XNIO version 3.4.0.Beta2
[Host Controller] 16:16:44,781 INFO  [org.xnio.nio] (MSC service thread 1-1) XNIO NIO Implementation Version 3.4.0.Beta2
[Host Controller] 16:16:44,812 INFO  [org.jboss.remoting] (MSC service thread 1-1) JBoss Remoting version 4.0.21.Final
[Host Controller] 16:16:44,850 WARN  [org.jboss.as.domain.management.security] (MSC service thread 1-3) WFLYDM0111: Keystore C:\BuildAgent\work\5768cf3a0bee5b47\full\testsuite\domain\target\domains\DefaultConfigSmokeTestCase\slave\configuration\application.keystore not found, it will be auto generated on first use with a self signed certificate for host localhost
[Host Controller] 16:16:44,870 INFO  [org.jboss.as.remoting] (MSC service thread 1-1) WFLYRMT0001: Listening on [::1]:19999
[Host Controller] 16:16:44,948 ERROR [org.xnio.listener] (management I/O-1) XNIO001007: A channel event listener threw an exception: java.lang.IllegalStateException: WFLYDM0043: No CallbackHandler available for mechanism LOCAL in realm ManagementRealm
[Host Controller] 	at org.jboss.as.domain.management.security.SecurityRealmService.getCallbackHandlerService(SecurityRealmService.java:254)
[Host Controller] 	at org.jboss.as.domain.management.security.SecurityRealmService.getAuthorizingCallbackHandler(SecurityRealmService.java:151)
[Host Controller] 	at org.jboss.as.remoting.RealmSecurityProvider.getCallbackHandler(RealmSecurityProvider.java:281)
[Host Controller] 	at org.jboss.as.remoting.RealmSecurityProvider$1.getCallbackHandler(RealmSecurityProvider.java:199)
[Host Controller] 	at org.jboss.remoting3.remote.ServerConnectionOpenListener$Initial.handleEvent(ServerConnectionOpenListener.java:298)
[Host Controller] 	at org.jboss.remoting3.remote.ServerConnectionOpenListener$Initial.handleEvent(ServerConnectionOpenListener.java:139)
[Host Controller] 	at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:92)
[Host Controller] 	at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:198)
[Host Controller] 	at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:112)
[Host Controller] 	at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:92)
[Host Controller] 	at org.xnio.ChannelListeners$DelegatingChannelListener.handleEvent(ChannelListeners.java:1092)
[Host Controller] 	at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:92)
[Host Controller] 	at org.xnio.conduits.ReadReadyHandler$ChannelListenerHandler.readReady(ReadReadyHandler.java:66)
[Host Controller] 	at org.xnio.nio.NioSocketConduit.handleReady(NioSocketConduit.java:89)
[Host Controller] 	at org.xnio.nio.WorkerThread.run(WorkerThread.java:565)
[Host Controller]
[Host Controller] 16:16:44,954 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0034: Host Controller boot has failed in an unrecoverable manner; exiting. See previous messages for details.
[Host Controller] 16:16:44,956 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0178: Aborting with exit code 99
[Host Controller] 16:16:44,964 INFO  [org.jboss.as] (MSC service thread 1-3) WFLYSRV0050: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) stopped in 4ms
16:16:45,320 INFO  [org.jboss.as.process.Host Controller.status] (reaper for Host Controller) WFLYPC0011: Process 'Host Controller' finished with an exit status of 99
16:16:45,322 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0017: Shutting down process controller

org.jboss.as.test.integration.domain.OrderedChildResourcesTestCase.testOrderedChildResources: java.lang.RuntimeException: Could not start container
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.awaitServers(DomainLifecycleUtil.java:449)
	at org.jboss.as.test.integration.domain.management.util.DomainLifecycleUtil.start(DomainLifecycleUtil.java:251)
	at org.jboss.as.test.integration.domain.OrderedChildResourcesTestCase.testOrderedChildResources(OrderedChildResourcesTestCase.java:69)
------- Stdout: -------
16:19:05,154 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
16:19:05,332 INFO  [org.jboss.as.process.Host Controller.status] (main) WFLYPC0018: Starting process 'Host Controller'
[Host Controller] 16:19:05,853 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
[Host Controller] 16:19:06,052 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
[Host Controller] 16:19:06,101 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) starting
[Host Controller] 16:19:06,663 INFO  [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0003: Creating http management service using network interface (management) port (9990) securePort (-1)
[Host Controller] 16:19:06,665 INFO  [org.xnio] (MSC service thread 1-5) XNIO version 3.4.0.Beta2
[Host Controller] 16:19:06,671 INFO  [org.xnio.nio] (MSC service thread 1-5) XNIO NIO Implementation Version 3.4.0.Beta2
[Host Controller] 16:19:06,719 WARN  [org.jboss.as.domain.management.security] (MSC service thread 1-1) WFLYDM0111: Keystore C:\BuildAgent\work\5768cf3a0bee5b47\full\testsuite\domain\target\domains\OrderedChildResourcesTestCase\master\configuration\application.keystore not found, it will be auto generated on first use with a self signed certificate for host localhost
[Host Controller] 16:19:06,725 INFO  [org.jboss.remoting] (MSC service thread 1-5) JBoss Remoting version 4.0.21.Final
[Host Controller] 16:19:06,759 INFO  [org.jboss.as.remoting] (MSC service thread 1-5) WFLYRMT0001: Listening on [::1]:9999
[Host Controller] 16:19:08,241 INFO  [org.jboss.as] (Controller Boot Thread) WFLYSRV0060: Http management interface listening on http://[::1]:9990/management
[Host Controller] 16:19:08,241 INFO  [org.jboss.as] (Controller Boot Thread) WFLYSRV0051: Admin console listening on http://[::1]:9990
[Host Controller] 16:19:08,242 INFO  [org.jboss.as] (Controller Boot Thread) WFLYSRV0025: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) (Host Controller) started in 2796ms - Started 55 of 56 services (18 services are lazy, passive or on-demand)
16:19:09,080 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
16:19:09,252 INFO  [org.jboss.as.process.Host Controller.status] (main) WFLYPC0018: Starting process 'Host Controller'
[Host Controller] 16:19:09,806 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final
[Host Controller] 16:19:10,033 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
[Host Controller] 16:19:10,088 INFO  [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) starting
[Host Controller] 16:19:10,728 INFO  [org.xnio] (MSC service thread 1-4) XNIO version 3.4.0.Beta2
[Host Controller] 16:19:10,766 INFO  [org.xnio.nio] (MSC service thread 1-4) XNIO NIO Implementation Version 3.4.0.Beta2
[Host Controller] 16:19:10,804 WARN  [org.jboss.as.domain.management.security] (MSC service thread 1-6) WFLYDM0111: Keystore C:\BuildAgent\work\5768cf3a0bee5b47\full\testsuite\domain\target\domains\OrderedChildResourcesTestCase\slave\configuration\application.keystore not found, it will be auto generated on first use with a self signed certificate for host localhost
[Host Controller] 16:19:10,835 INFO  [org.jboss.remoting] (MSC service thread 1-4) JBoss Remoting version 4.0.21.Final
[Host Controller] 16:19:10,865 INFO  [org.jboss.as.remoting] (MSC service thread 1-1) WFLYRMT0001: Listening on [::1]:19999
[Host Controller] 16:19:10,877 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0034: Host Controller boot has failed in an unrecoverable manner; exiting. See previous messages for details.
[Host Controller] 16:19:10,881 FATAL [org.jboss.as.host.controller] (Controller Boot Thread) WFLYHC0178: Aborting with exit code 99
[Host Controller] 16:19:10,892 INFO  [org.jboss.as] (MSC service thread 1-2) WFLYSRV0050: WildFly Full 10.1.0.Final-SNAPSHOT (WildFly Core 3.0.0.Alpha4-SNAPSHOT) stopped in 5ms
16:19:11,240 INFO  [org.jboss.as.process.Host Controller.status] (reaper for Host Controller) WFLYPC0011: Process 'Host Controller' finished with an exit status of 99
16:19:11,242 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0017: Shutting down process controller
16:19:11,242 INFO  [org.jboss.as.process] (Thread-8) WFLYPC0016: All processes finished; exiting

A standalone server can also use NativeRemotingManagementAddHandler so this should cover that too.

Windows Build 3627 outcome was FAILURE using a merge of 777afc893ebfedb5b0133ee2eb9ec7e706a5266e
Summary: Tests failed: 1 (1 new), passed: 3770, ignored: 56 Build time: 00:52:06
Failed tests
org.jboss.as.test.integration.management.cli.CliAliasTestCase.testAliasPersistence: java.lang.AssertionError: Alias was not saved to .aesh_aliases
	at org.jboss.as.test.integration.management.cli.CliAliasTestCase.testAliasPersistence(CliAliasTestCase.java:195)

Core - Full Integration Build 3267 outcome was FAILURE using a merge of 84a84017c13f074fbaf661c3b30a514a6652c6c2
Summary: Error while applying patch Build time: 00:00:31

Core - Full Integration Build 3260 outcome was UNKNOWN using a merge of 84a84017c13f074fbaf661c3b30a514a6652c6c2
Summary: Canceled Build time: 67:53:06

Core - Full Integration Build 3270 outcome was FAILURE using a merge of 84a84017c13f074fbaf661c3b30a514a6652c6c2
Summary: Tests failed: 1 (1 new), passed: 3437, ignored: 194 Build time: 01:02:57
Failed tests
org.jboss.as.test.xts.annotation.compensationScoped.CompensationScopedTestCase.shouldSeeDifferentValuesInDifferentTransactions: com.arjuna.mw.wsas.exceptions.WrongStateException: ARJUNA041018: Cannot enlist child activity with parent as parent's status is: Status.Completed
	at com.arjuna.mwlabs.wsas.activity.ActivityImple.addChild(ActivityImple.java:583)
	at com.arjuna.mwlabs.wsas.activity.ActivityImple.start(ActivityImple.java:160)
	at com.arjuna.mwlabs.wsas.UserActivityImple.start(UserActivityImple.java:136)
	at com.arjuna.mwlabs.wsas.UserActivityImple.start(UserActivityImple.java:99)
	at com.arjuna.mwlabs.wscf.model.sagas.arjunacore.CoordinatorServiceImple.begin(CoordinatorServiceImple.java:108)
	at org.jboss.narayana.compensations.impl.local.LocalBAController.beginBusinessActivity(LocalBAController.java:28)
	at org.jboss.as.test.xts.annotation.compensationScoped.CompensationScopedTestCase.shouldSeeDifferentValuesInDifferentTransactions(CompensationScopedTestCase.java:76)
------- Stdout: -------
 [0m04:14:19,366 INFO  [org.wildfly.extension.undertow] (ServerService Thread Pool -- 86) WFLYUT0022: Unregistered web context: /transactional-test
 [0m [0m04:14:19,377 INFO  [org.jboss.as.webservices] (MSC service thread 1-2) WFLYWS0004: Stopping service jboss.ws.endpoint."transactional-test.war".TransactionalServiceImpl
 [0m [0m04:14:19,390 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 94) WFLYCLINF0003: Stopped client-mappings cache from ejb container
 [0m [0m04:14:19,409 INFO  [org.jboss.as.server.deployment] (MSC service thread 1-3) WFLYSRV0028: Stopped deployment transactional-test.war (runtime-name: transactional-test.war) in 43ms
 [0m [0m04:14:19,417 INFO  [org.jboss.as.repository] (management-handler-thread - 3) WFLYDR0002: Content removed from location /opt/buildAgent/work/29472398f1ae6497/full/testsuite/integration/xts/target/jbossas/standalone/data/content/3f/adab2d62f6a056a6d00e8e9d8a1bd732d873f9/content
 [0m [0m04:14:19,417 INFO  [org.jboss.as.server] (management-handler-thread - 3) WFLYSRV0009: Undeployed "transactional-test.war" (runtime-name: "transactional-test.war")
 [0m [0m04:14:20,052 INFO  [org.jboss.as.repository] (management-handler-thread - 4) WFLYDR0001: Content added at location /opt/buildAgent/work/29472398f1ae6497/full/testsuite/integration/xts/target/jbossas/standalone/data/content/19/19ff1da67aaad210e5eb445e60359c105ae584/content
 [0m [0m04:14:20,054 INFO  [org.jboss.as.server.deployment] (MSC service thread 1-8) WFLYSRV0027: Starting deployment of "test.war" (runtime-name: "test.war")
 [0m [0m04:14:20,167 INFO  [org.jboss.weld.deployer] (MSC service thread 1-8) WFLYWELD0003: Processing weld deployment test.war
 [0m [0m04:14:20,362 INFO  [org.wildfly.extension.undertow] (ServerService Thread Pool -- 94) WFLYUT0021: Registered web context: /test
 [0m [0m04:14:20,368 INFO  [org.jboss.as.server] (management-handler-thread - 4) WFLYSRV0010: Deployed "test.war" (runtime-name : "test.war")
 [0m

Windows Build 3634 outcome was FAILURE using a merge of 84a84017c13f074fbaf661c3b30a514a6652c6c2
Summary: Tests failed: 1, passed: 3770, ignored: 56 Build time: 01:08:47
Failed tests
org.jboss.as.test.integration.management.cli.CliAliasTestCase.testAliasPersistence: java.lang.AssertionError: Alias was not saved to .aesh_aliases
	at org.jboss.as.test.integration.management.cli.CliAliasTestCase.testAliasPersistence(CliAliasTestCase.java:195)

retest this please

retest this please


Enforce prevention downloading same file

Checklist

[x] I'm reporting a feature request
[ ] I've verified that I'm running youtube-dl version 2019.08.13
[ ] I've searched the bugtracker for similar feature requests including closed ones

I am not sure if this is feature request, it's 2019.07.30 that i use
this is the full info
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.07.30
[debug] Python version 2.7.12 (CPython) - Linux-4.15.0-58-generic-x86_64-with-LinuxMint-18.3-sylvia
[debug] exe versions: ffmpeg 2.8.15, ffprobe 2.8.15
[debug] Proxy map: {}
Usage: youtube-dl [OPTIONS] URL [URL...]

youtube-dl: error: You must provide at least one URL.

## Description

What the problem is

It already downloaded the x.webm file, but it repeats download again and unfortunately changes to x.mp4

This one is youtube-dl output-ed to mp3

this one is to re-confirm the youtube-dl output-ed to mp3

How it could be fixed
Firstly, it's my suspicion that 1. we do check with the desired vidio.extension. While i am proposing we do check existing downloaded file with only the video name, without extension.
Also, it should be the same, regardless of the desired file output.
Having said that, i never know or read about the video or output quality.

FYI those above behavior is not use --download-archive option

How your proposed solution would look like
Always check existing file first, with file default video name as it's the file name and without the file extension.

Related to point 1, can we just make the default youtube-dl behavior when using --yes-playlist use --download-archive with a default file name. IE playlist_id.txt.
I think it can be tackle down with #16790
not use download archive

You must use --download-archive for this.

do you think when using --yes-playlist also involving --download-archive is a bad suggestion?

It's a very bad suggestion.

Then you owe me and explanation :wink:

It's a very bad suggestion.

I'm confused, why?


Update govuk elements sass

This PR adds govuk-elements-sass to the list of dependencies, so that it exists within /node-modules/, in the same way as the govuk front end toolkit and govuk template.
The files from govuk_elements/public/sass are copied to app/assets/sass/, and the application Sass file now imports a single partial govuk-elements.scss.
This means that changes to govuk elements can be made without overriding any changes to the application.scss file.
To use a custom set of modules from the govuk frontend toolkit and govuk elements (rather than all of them), the import statements in _govuk-elements.scss can be copied into the application stylesheet, so here the partial would exist as a reference for any newly created modules.
Version 1.1.0 of govuk elements is referred to in th  list of dependencies in package.json.
"govuk-elements-sass": "alphagov/govuk_elements#v1.1.0"

Any examples which use classnames that have changed are also updated.
cc. @tombye, @robinwhittleton, @timpaul.

Tested with a fresh clone:
git checkout -b update-govuk-elements-sass origin/update-govuk-elements-sass
npm install
The only thing missing was the updated markup for the breadcrumb, this is added in:  b4898f8.


feat(perf): improve time of running dbt by pre installing requirements

Description
This PR improves the time it takes to run DBT by pre-installing required packages by aspects-dbt.

Thanks for the pull request, @Ian2012! Please note that it may take us up to several weeks or months to complete a review and merge your PR.
Feel free to add as much of the following information to the ticket as you can:

supporting documentation
Open edX discussion forum threads
timeline information ("this must be merged by XX date", and why that is)
partner information ("this is a course on edx.org")
any other information that can help Product understand the context for the PR

All technical communication about the code itself will be done via the GitHub pull request interface. As a reminder, our process documentation is here.
Please let us know once your PR is ready for our review and all tests are green.

@Ian2012 🎉 Your pull request was merged!  Please take a moment  to answer a two question survey so we can improve your experience in the future.


evdev.uinput.UInputError: "/dev/uinput" cannot be opened for writing

Don't have time to make a PR, but to avoid the error from issue title, I'd propose adding a  /etc/udev/rules.d/10-evdevremapkeys.rules file to examples with the following content:
# uncomment in case of:
#     evdev.uinput.UInputError: "/dev/uinput" cannot be opened for writing
# see https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=827240
#KERNEL=="uinput", SUBSYSTEM=="misc", OPTIONS+="static_node=uinput", TAG+="uaccess", GROUP="input", MODE="0660"

(shall solve issues on Debian and ArchLinux)

Fair call. I have the steam deb installed which adds this rule for steam controller purposes. Can add after we merge #23

I think this is given in the docs work I did. Please check


Legendary cost support

Currently the sheet doesn't parse out the legendary action points value either from the SRD or script import. It also doesn't parse out the costs on individual actions where they are more than one "(costs 2 actions)" - and there isn't actually a place for this value to go.
Ideally at some point legendary points would be able to auto-decrement with script support the way ammo does at the moment.

Hmmm. Looking at the sheet worker code, it should be getting the overall action count. But for some reason it isn't. I tested with an Ancient Black Dragon from the SRD.

Ok I've fixed the count parsing and sent you a PR: https://github.com/mlenser/roll20-character-sheets/pull/123 The other stuff is more of an enhancement request I guess.

Closed as part of my new issue tracker via bitbucket


Add Zip file export of all data

Suggested by @igorw

This issue was moved to tightenco/symposium#21

This can be closed because of https://github.com/tightenco/symposium/pull/44 right?


[Blazor] Consider passing argsJson as byte[] from the client to dispatcher calls

We could avoid doing work on the server to convert UTF16 string -> UTF8 byte array and instead have the client pass in the correctly encoded byte array. There's an API and polyfill to produce a utf8 byte array in the browser - https://github.com/samthor/fast-text-encoding

Since this isn't user visible, it should be safe to do this as part of a future milestone.


update gulp.bat to be equivalent to gulp bash script

Improvement of gulp.bat, equivalent to gulp shell script.

allow for specifying task
runs gulp forever if exited with error code - uses simple scripting in favor of forever which has annoying popups on child_process.spawn (pandoc).

ref batch scripts: http://www.infionline.net/~wtnewton/batch/batguide.html

@tjesi tested it and it seems to work


tests: bluetooth: Central misses a connection params update req

This is to show when a Central device misses a connection parameters update request when connecting to 4 Peripherals through the following procedure
1 - Central starts a scanning procedure
2 - When a device is found, central attempt to connect to it
3 - When the 'connected' callback is received, a signal is set to start
a new scanning procedure from the main thread
4 - When a peripheral is connected, it sends a connection parameters
update request
The 4 Peripherals are connected successfully, but one of the connection parameters update request is missed (usually 3rd)
Signed-off-by: Ahmed Moheb<EMAIL_ADDRESS>

@jori-nordic @alwa-nordic please check this

RFC issue https://github.com/zephyrproject-rtos/zephyr/issues/51984#event-7760825072 was closed


all: format with Go 1.19

Update Go source files to use the '//go:build' lines introduced by Go 1.17 and the doc comment formatting introduced by Go 1.19. This formatting is not changed by Go 1.20.
Note: doc.go and the *userauth* files  had to be manually changed in some places to fix indentation.
This does not change how godoc (at least with Go 1.19) renders the package documentation and is backwards compatible (i.e. earlier versions of gofmt will leave this code unchanged - tested with 1.17).

@mattn Please consider merging this. This is blocking further efforts aiming to improve documentation.

Codecov Report
Attention: 3 lines in your changes are missing coverage. Please review.

Comparison is base (1603038) 46.80% compared to head (af13bcb) 46.59%.
Report is 6 commits behind head on master.

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1130      +/-   ##
==========================================
- Coverage   46.80%   46.59%   -0.22%
==========================================
  Files          12       12
  Lines        1534     1526       -8
==========================================
- Hits          718      711       -7
+ Misses        673      672       -1
  Partials      143      143

Files
Coverage Δ

sqlite3_go18.go
77.77% <ø> (-4.58%)
:arrow_down:

sqlite3_load_extension.go
59.37% <ø> (ø)

sqlite3_opt_serialize.go
82.85% <ø> (ø)

sqlite3_opt_userauth_omit.go
10.00% <ø> (ø)

sqlite3.go
52.64% <50.00%> (ø)

callback.go
58.53% <33.33%> (ø)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

@mattn We definitely need this change merged before submitting further documentation improvements!

Closing since https://github.com/mattn/go-sqlite3/pull/1208 took care of this.


Deploy ionic app to web

Deploy the prod build of ionic app to web host and serve with NGINX

Deploy


WebSocket Server

Required for the Web UI to integrate with 'tasklist.core' and then the users file system
https://actix.rs/docs/websockets/

https://github.com/actix/examples/blob/master/websockets/chat/src/main.rs

POC Done


Fix gitleaks import when no findings found

This PR seems to contains also the changes from #4024 , so could you fix that first so we can merge that one?

This PR seems to contains also the changes from #4024 , so could you fix that first so we can merge that one?

✅


Preset for different color themes

It would be nice to have 2 presets, one for VSC dark theme mode, another for VSC light mode.
When I switch system theme with VSC theme changed automatically, but the Blockman cannot do it too

When I switch dark/light theme of VS Code, Blockman automatically adjusts blockman color combo.

Please check what values do you have in these 4 settings of Blockman?

This worked!
Thanks!
Probably this was not the default, or I destroyed it.


signalSorter improvements, general git downloader, and misc updates

signalSorter - Allow zoom and other functionality and a lock-check to prevent skipping forward to new cells based on pressing keyboard too long carrying over keypress into next source output, causing it to skip over outputs.
signalSorter - changed how axes are called to allow more flexibility with other UI elements.
signalSorter - Added progress bar for cell, non-cell, and unknown.
viewAcceptedRejectedCellExtraction - additional options to improve display.
Change additional functions that download and load external software packages to use '_external_programs' folder.
Added a general github repo downloader, at the moment supports NoRMCorre, additional support coming.

Checked whole pipeline on Windows with MATLAB 2018b and functional (see below for ICA, CNMF, CNMF-E, and ROI analysis). Outside software now in _external_programs.
Merging.


Anyone know why angular related project prefer to use grunt?

I noticed that official semantic is using gulp for building tools, why angular version are using grunt, any special reason?

@oneseven, I think there is no special reason. @0xAX set it up like that at the beginning and it does the job. Since we don't build the semantic-ui project during the angular-semantic-ui building process, no matter if we use Grunt or Gulp (IMHO).
I used to build my projects with Grunt and to be honest, I never needed Gulp. What could be benefit of switching to Gulp?

I used Grunt and now use Gulp, only for the reason that the tasks are tidier and clearer and sometimes Gulp is faster

We need better reasons to switch to Gulp. We never had trouble with it and Grunt is still maintain.
I keep this issue open and wait for more pro and con

Keep using Grunt, you already have it implemented. There's no reason to switch, it will only cause more hassle. To choose either, do so at the beginning of a project, not halfway through.
If Grunt works for you, use Grunt. If you prefer Gulp, use Gulp.
Also as mentioned, the official SemanticUI uses Gulp but you aren't building SemanticUI, so that has nothing to do with the other, stick with Grunt.


Regenerates Code from Repo Rename

Regenerates code from running ci/check-generated-code.sh script due to repo rename.

Whoo

thanks for getting this name change ci green!

The gateway api conformance tests CI job is failing due to:
    --- FAIL: TestConformance/HTTPRouteServiceTypes (1.18s)
        --- PASS: TestConformance/HTTPRouteServiceTypes/2_request_to_'/headless'_should_go_to_infra-backend-v1 (0.01s)
        --- FAIL: TestConformance/HTTPRouteServiceTypes/0_request_to_'/manual-endpointslices'_should_go_to_infra-backend-v1 (30.00s)
        --- FAIL: TestConformance/HTTPRouteServiceTypes/1_request_to_'/headless-manual-endpointslices'_should_go_to_infra-backend-v1 (30.00s)

I'm unable to reproduce this failure locally:
$ gateway-api git:(heads/v1.1.0) ✗ go test -v ./conformance -run TestConformance -args \
    --gateway-class=gloo-gateway \
    --supported-features=HTTPRouteServiceTypes \
--conformance-profiles=GATEWAY-HTTP
...
   --- PASS: TestConformance/HTTPRouteServiceTypes (1.17s)
        --- PASS: TestConformance/HTTPRouteServiceTypes/1_request_to_'/headless-manual-endpointslices'_should_go_to_infra-backend-v1 (0.03s)
        --- PASS: TestConformance/HTTPRouteServiceTypes/0_request_to_'/manual-endpointslices'_should_go_to_infra-backend-v1 (0.03s)
        --- PASS: TestConformance/HTTPRouteServiceTypes/2_request_to_'/headless'_should_go_to_infra-backend-v1 (0.03s)
...
PASS
ok  	sigs.k8s.io/gateway-api/conformance	70.099s

I am rerunning the job.


Fix APU sound bugs

Some sounds don't play correctly such as LZA Link falling, game over screen sounds are also wrong

Seems like the sweep doesn't work correctly

There is something wonky going on with the sweep, tetris rotation sounds also sound wrong

Fixed by changing write_mem timing on the write for the NRx4 registers


Make API behaviour more consistant

The "Change reported review issues" commit needs to be rebased into the other commit.


»Open Timeline« shows blank grey screen

Hi! I wanted to try out the app and clicked »Start Remembering«, use my Computer for like 10 Minutes, clicked »Stop Remembering« and then »Open Timeline«. It open a fullscreen, blank grey window with no controls and no content. Is there any way i can send you debug information?
Also clicking on »Search« results in the screen i attached, it seems the screenshots are not correctly loaded?
I'd love to be able to help more on this!

I've seen your issue- that's not good! I will look into it.

I believe this is working properly now… locally. I’m getting ready to create another build but I’m trying to do an official one with Apple (non-app store) so figuring out code signing. If it takes too long I’ll make another unofficial

I'm hoping this release works better for you - still plenty of issues: https://github.com/jasonjmcghee/rem/releases/tag/v0.1.2

@mourique Could you check ~/Library/Application\ Support/today.jason.rem and see if there are any mp4s? I'm thinking ffmpeg might have failed to run. We're flying blind as there is no logging- at all.

No sqlite db either! I will investigate. Out of curiosity, do you have a folder at /Users/jason/Library/Containers/today.jason.rem/Data/Library/Application Support/today.jason.rem - the hardened app sandbox may be putting it there now instead (going to add to readme as well...)

@jasonjmcghee This is also happening for me as well. I'm still able to paste previous context, so it seems like it's still capturing. I have .mp4 files in ~/Library/Application\ Support/today.jason.rem
M2 air, macOS Sonoma 14.0 - did a full restart as well
installed via v0.1.5dmg

mind trying https://github.com/jasonjmcghee/rem/releases/tag/v0.1.6?

I have similar issue, and the reason for me why that page is blank is because it seems like no images have been taken. All output-dd.mp4 files are zero bytes.
Search works but i believe it only works on a window/tab titles/urls so far, so content is not visible.
Running Sonoma 14.2.1.
Permissions to record screen were granted and I even restarted few times.
console app show this kind of errors from imagenet process, might be relevant ?
Error communicating with persistent store service proxy: Error Domain=NSCocoaErrorDomain Code=4099 "The connection to service named com.apple.contactsd.persistence was invalidated: failed at lookup with error 159 - Sandbox restriction." UserInfo={NSDebugDescription=The connection to service named com.apple.contactsd.persistence was invalidated: failed at lookup with error 159 - Sandbox restriction.}

Also, seems like 0.1.6 is more resource-intensive, up to making whole system sluggish. 0.1.5 was running smoother but also not recording images :)
Thanks! Great efforts 👏

Oh no! Worse? I will add a note to the release...

contactsd issue... I was really trying to follow all Apple security best practices, but concerned it's not letting it write to its own folder.
This seems relevant: https://discussions.apple.com/thread/254659981?sortBy=best

@lotas were you streaming with the console app when you ran 0.1.6? Because that will absolutely cause performance issues

Just had a thought - in order to get things signed properly I created ffmpegX. I'm wondering if somehow, when the app isn't running on my computer (ugh) that ffmpegX doesn't have access to rem's Application Support location, due to sandboxing.
Crazy that it could create the files, just not, write to them?

If someone runs into this, and is willing to try xattr -c rem.app that will remove gatekeeper stuff which should remove "sandbox". If it does, that will be pretty strong evidence of where we need to investigate / debug"

So I did apply xattr -c, I have ffmpeg also installed on the system, and I see sqlite db growing and empty videos at /Users/yaraslaukurmyza/Library/Containers/today.jason.rem/Data/Library/Application Support/today.jason.rem

It's "sluggish" feeling- is that during scrubbing in the timeline
Everything.. but I think after few restarts it got better, although Activity shows %cpu floats around 15-20% but Energy Impact shows crazy values around 380-490 (whatever units those are)
(I tried both with and without console running)

Crazy that it could create the files, just not, write to them?
Is there a way to debug this?

Yeah that medianalysisd is ocr...
Things I'd try:

trying to execute the ffmpeg command manually with the embedded ffmpeg
swapping out the embedded ffmpeg with your homebrew one
Try building it yourself with my script!

No luck so far, but I'm pretty sure the problem is somewhere around ffmpeg for me. Tried replacing with homebrew version but nothing's happening.
Although, when I tried to mimic the png stuff i got some codec errors like below, where my ffmpeg would run fine, but embedded one would. (maybe doing something wrong here also)

Btw, between 0.1.5 and 0.1.6 UI was "broken":

when toggling timeline just gray window appears, in 0.1.5 it had a message in the center "nothing to remember.."
search also stopped showing images initially, just all blank space and input is not focused, window not active.

I'm not sure how helpful that is though :)

The errors here seems like it wants MP4 extension. Did you try specifying the codec as h264_videotoolbox?

Managed to repro this, but mp4 etc. all working fine, search working etc. but getting gray timeline, until quitting and reopening. i think this is a potentially unrelated issue?

when toggling timeline just gray window appears, in 0.1.5 it had a message in the center "nothing to remember.."

Made a ton of progress on this. still working on it, but things are making a lot more sense. there were some bound variables that were updating and causing repeated re-renders

Managed to repro this, but mp4 etc. all working fine, search working etc. but getting gray timeline, until quitting and reopening. i think this is a potentially unrelated issue?

when toggling timeline just gray window appears, in 0.1.5 it had a message in the center "nothing to remember.."

Both should be fixed in 0.1.8

The inability for some users to write data at all is still the main issue here and not fixed AFAIK.

@lotas

Is there a way to debug this?

 I will do it next year ;)

complains about sqlite library missing

Did you make sure it was marked as macos instead of iOS? (as per screenshot in readme)
I'd also make sure to do clean build too. I have to do it pretty regularly.

Ha! So I managed to make it work finally, it had to do with the fact that I don't have a developer account.. so I had to disable all that signing and tell "Disable Library Validation Entitlement" for sqlite .. anyways.. so it runs just fine and in that debug builds ffmpeg works flawlessly 😂
Not sure what's not right with the release package.

@lotas thank you- yeah that tells me there’s still something to do with either hardened runtime / app sandbox that’s preventing it from working for people who are downloading the release.
Will continue investigating…

Alright. I did a bunch of... stuff... to do with entitlements etc.
Would love if someone having this issue try https://github.com/jasonjmcghee/rem/releases/tag/v0.1.9
Sorry for all the failures 🤦 - I'm trying. Never released an app through apple before and all the security / codesigning stuff is throwing me for a loop.
cc @mourique @lotas

Also happy to invite one of you to the TestFlight, and see if that works:

@mourique I need to invite you via email. I can send to the one posted on your personal site? If not, feel free to email me whichever preferred email to<EMAIL_ADDRESS>

Oof, I have to wait for external testflight app review. I'll add the latest dmg to 0.1.9 - it should have the same fixes? 🤞

I think 0.1.9 is finally recording videos and have screenshots! 🎉 Great job, thanks!

If @mourique signs off on 0.1.9 dmg, I’ll close!

it never ends! 😂 Thank YOU for reporting and helping debug! It was huge.


feat(scale)!: add new class with pattern and reversed getters

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

24 of 29 (82.76%)  changed or added relevant lines in 3 files are covered.
2 unchanged lines in 1 file lost coverage.
Overall coverage decreased (-1.3%) to 98.659%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

lib/src/scale/scale.dart
15
20
75.0%

Files with Coverage Reduction
New Missed Lines
%

lib/src/scale/scale_pattern.dart
2
94.12%

Totals

Change from base Build<PHONE_NUMBER>:
-1.3%

Covered Lines:
515

Relevant Lines:
522

💛  - Coveralls


"make run" does not seem to work

What happened?
I'm getting this error:
make run
14:42:09 [ .. ] go build linux_amd64
go build: -i flag is deprecated
14:42:10 [ OK ] go build linux_amd64
14:42:10 [ .. ] Running Crossplane locally out-of-cluster . . .
/home/rspazzol/git/provider-gcp/_output/bin/linux_amd64/provider-gcp --debug
/bin/bash: line 1: /home/rspazzol/git/provider-gcp/_output/bin/linux_amd64/provider-gcp: No such file or directory
make: *** [Makefile:109: run] Error 127

the problem seems to be that the binary created by the previous compilation step is provider instead of provider-gcp.
How can we reproduce it?
clone master and Run make run

@raffaelespazzoli good catch, could you change $(PROJECT_NAME) to just provider in the Makefile section below?
https://github.com/crossplane/provider-gcp/blob/a96c0e34256912132118fbc3eaa8aa5fb02cb85d/Makefile#L109

Seems like this break is similar to other providers as well, to be honest I don't know what changed to this bug appear, but we may need to make this similar fix to other repositories.
I run in a similar issue when developing code for provider-github.


Date display frontend

Dates are no longer readable on the Dash slider. If someone smarter than me knows how to rotate the labels, that'd be great.
https://www.woidmo.org/home/womo/womo-united-states/

Fix is under date_display_fix branch. Please check.

Fix is under date_display_fix branch. Please check.

That looks a whole lot better. Could you please do SouthAm and US as well?

That looks a whole lot better. Could you please do SouthAm and US as well?

Fixed SouthAm and US date slider display under date_display_fix branch. Please check.

Fixed SouthAm and US date slider display under date_display_fix branch. Please check.

Works perfectly, Thank you!

Works perfectly, Thank you!


[BUG] URL Bug

strip("let something = 'https://example.com';");

Expected output:

let something = 'https://example.com';

Fact output:

let something = 'https:

I have the same problem.

I'm currently vetting this repo and to see how it handles edge cases and trying to get a better understanding of how it works.

strip("let something = 'https://example.com';");

Expected output:

let something = 'https://example.com';
Fact output:
let something = 'https:

I actually don't experience this behavior, are you using the most recent release?

s.url = ( ( url || s.url || location.href ) + "" )
  .replace( rprotocol, location.protocol + "//" );

^ This one is interesting, . I looked into it and found that the bug actually is related to the empty string on the first line. This regex is looking for one or more characters between quote characters, so an empty string (with zero characters) results in a weird edge case. It thinks the innards of that quote are everything leading up to the first quote in the "//", so it doesn't register the double slash as being a quoted piece of text.
It seems to be fixed if you change that regex to use ^(['"])((?:\.|[^\1])?)(\1)` (changes the '+' to a '' to capture zero or more instead of one or more. I'm unsure if this has negative implications in other places, but it seems like a safe change (at least for javascript comment stripping).

I am experiencing this issue as well. It's a dealbreaker for me

Are they still going to fix this?

Are they still going to fix this?

This repo is solved https://github.com/freeCodeCamp/strip-comments


AV in coreclr during long haul with Ngnix

The server was running HelloWorldMvc with Nginx as reverse proxy. 500-1000 clients kept sending requests.
(lldb) thread select 1

thread #1: tid = 0, 0x00007f68f8beff53 libcoreclr.soJIT_CheckedWriteBarrier_End + 3, name = 'dnx', stop reason = signal SIGSEGV   frame #0: 0x00007f68f8beff53 libcoreclr.soJIT_CheckedWriteBarrier_End + 3
-> 0x7f68f8beff53 <JIT_CheckedWriteBarrier_End+3>: movq   %rcx, (%rdi)

Several threads were trying to allocate objects at that time, and thread 14 just finished a GC at that time.
Thread 14 just did a GC:

thread #14: tid = 13, 0x00007f68fa16208a libpthread.so.0__lll_unlock_wake + 26, stop reason = signal SIGSEGV   frame #0: 0x00007f68fa16208a libpthread.so.0__lll_unlock_wake + 26
frame #1: 0x00007f68fa15e8a4 libpthread.so.0_L_unlock_722 + 15   frame #2: 0x00007f68f8f9065e libcoreclr.soCorUnix::CThreadSynchronizationInfo::RunDeferredThreadConditionSignalings() [inlined] CorUnix::CPalSynchronizationManager::SignalThreadCondition(CorUnix::_ThreadNativeWaitData*) + 72 at synchmanager.cpp:2628
frame #3: 0x00007f68f8f90616 libcoreclr.soCorUnix::CThreadSynchronizationInfo::RunDeferredThreadConditionSignalings(this=0x00007f684828f670) + 70 at synchmanager.cpp:4592   frame #4: 0x00007f68f8f8a062 libcoreclr.soCorUnix::CSynchControllerBase::Release() + 130 at synchmanager.hpp:639
frame #5: 0x00007f68f8f8a02e libcoreclr.soCorUnix::CSynchControllerBase::Release(this=0x00007f6844042508) + 78 at synchcontrollers.cpp:111   frame #6: 0x00007f68f8f88eaa libcoreclr.soSetEvent [inlined] CorUnix::InternalSetEvent(hEvent=, fSetEvent=BOOL at scalar) + 113 at event.cpp:447
frame #7: 0x00007f68f8f88e39 libcoreclr.soSetEvent(hEvent=<unavailable>) + 57 at event.cpp:336   frame #8: 0x00007f68f8bc6d78 libcoreclr.soThreadSuspend::RestartEE(int, int) + 584

frame #9: 0x00007f68f8cad8a7 libcoreclr.soWKS::GCHeap::GarbageCollectGeneration(unsigned int, WKS::gc_reason) + 855 frame #10: 0x00007f68f8caf381 libcoreclr.soWKS::gc_heap::try_allocate_more_space(alloc_context*, unsigned long, int) + 561
frame #11: 0x00007f68f8ccfe6d libcoreclr.soWKS::GCHeap::Alloc(alloc_context*, unsigned long, unsigned int) + 141 frame #12: 0x00007f68f8b573ce libcoreclr.soAllocateObject(MethodTable*) + 158
frame #13: 0x00007f68f8b6a0ee libcoreclr.soJIT_New(CORINFO_CLASS_STRUCT_*) + 350 … frame #60: 0x00007f68f8bef937 libcoreclr.soCallDescrWorkerInternal + 124
frame #61: 0x00007f68f8b2bc02 libcoreclr.soMethodDescCallSite::CallTargetWorker(unsigned long const*) + 818 frame #62: 0x00007f68f8cfe74a libcoreclr.soQueueUserWorkItemManagedCallback(void*) + 186
frame #63: 0x00007f68f8b0034b libcoreclr.soManagedThreadBase_DispatchOuter(ManagedThreadCallState*) + 427 frame #64: 0x00007f68f8b00ad6 libcoreclr.soManagedThreadBase::ThreadPool(ADID, void ()(void), void*) + 70
frame #65: 0x00007f68f8ce29f5 libcoreclr.soManagedPerAppDomainTPCount::DispatchWorkItem(bool*, bool*) + 293 frame #66: 0x00007f68f8b1e6bc libcoreclr.soThreadpoolMgr::WorkerThreadStart(void*) + 1228
frame #67: 0x00007f68f8f96809 libcoreclr.soCorUnix::CPalThread::ThreadEntry(pvParam=0x00007f684828f500) + 297 at thread.cpp:1620 frame #68: 0x00007f68fa15b182 libpthread.so.0start_thread + 194
frame #69: 0x00007f68f966847d libc.so.6`clone + 109

This thread was trying to serve the view from the managed stack:
OS Thread Id: 0x36ce (16)
Child SP               IP Call Site
00007F685F7F9B88 00007F68FA15F414 [HelperMethodFrame: 00007f685f7f9b88]
00007F685F7FA240 00007F6880371412 DynamicClass.lambda_method(System.Runtime.CompilerServices.Closure, Microsoft.Extensions.DependencyInjection.ServiceProvider)
00007F685F7FA3F0 00007F687FF3C618 Microsoft.Extensions.DependencyInjection.ServiceProviderExtensions.GetRequiredService(System.IServiceProvider, System.Type)
00007F685F7FA410 00007F688057F3BC Microsoft.AspNetCore.Mvc.Razor.RazorPageActivator+<>c__DisplayClass7_0.b__2(Microsoft.AspNetCore.Mvc.Rendering.ViewContext)
00007F685F7FA440 00007F688057EC65 Microsoft.Extensions.Internal.PropertyActivator1[[System.__Canon, mscorlib]].Activate(System.Object, System.__Canon) 00007F685F7FA470 00007F688057CB69 Microsoft.AspNetCore.Mvc.Razor.RazorPageActivator.Activate(Microsoft.AspNetCore.Mvc.Razor.IRazorPage, Microsoft.AspNetCore.Mvc.Rendering.ViewContext) 00007F685F7FA4B0 00007F688057CA43 Microsoft.AspNetCore.Mvc.Razor.RazorView.RenderPageCoreAsync(Microsoft.AspNetCore.Mvc.Razor.IRazorPage, Microsoft.AspNetCore.Mvc.Rendering.ViewContext) 00007F685F7FA4E0 00007F688057BF90 Microsoft.AspNetCore.Mvc.Razor.RazorView+<RenderPageAsync>d__14.MoveNext() 00007F685F7FA530 00007F688057B8CB System.Runtime.CompilerServices.AsyncTaskMethodBuilder1[[System.__Canon, mscorlib]].Start[[Microsoft.AspNetCore.Mvc.Razor.RazorView+d__14, Microsoft.AspNetCore.Mvc.Razor]](d__14 ByRef)
00007F685F7FA560 00007F688057B827 Microsoft.AspNetCore.Mvc.Razor.RazorView.RenderPageAsync(Microsoft.AspNetCore.Mvc.Razor.IRazorPage, Microsoft.AspNetCore.Mvc.Rendering.ViewContext, Boolean)
00007F685F7FA610 00007F688057B525 Microsoft.AspNetCore.Mvc.Razor.RazorView+d__13.MoveNext()
00007F685F7FA650 00007F688057B401 System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[Microsoft.AspNetCore.Mvc.Razor.RazorView+d__13, Microsoft.AspNetCore.Mvc.Razor]](d__13 ByRef)
00007F685F7FA680 00007F688057B36A Microsoft.AspNetCore.Mvc.Razor.RazorView.RenderAsync(Microsoft.AspNetCore.Mvc.Rendering.ViewContext)
00007F685F7FA710 00007F6880575A1D Microsoft.AspNetCore.Mvc.ViewFeatures.ViewExecutor+d__17.MoveNext()
00007F685F7FA790 00007F68805756B1 System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[Microsoft.AspNetCore.Mvc.ViewFeatures.ViewExecutor+d__17, Microsoft.AspNetCore.Mvc.ViewFeatures]](d__17 ByRef)
00007F685F7FA7C0 00007F6880575615 Microsoft.AspNetCore.Mvc.ViewFeatures.ViewExecutor.ExecuteAsync(Microsoft.AspNetCore.Mvc.ActionContext, Microsoft.AspNetCore.Mvc.ViewEngines.IView, Microsoft.AspNetCore.Mvc.ViewFeatures.ViewDataDictionary, Microsoft.AspNetCore.Mvc.ViewFeatures.ITempDataDictionary, System.String, System.Nullable`1)
…
After GC was done, thread 14 was notifying other 2 waiting thread about this event
(lldb) p ((CPalThread*)  0x00007f684828f500)->synchronizationInfo
…
m_lPendingSignalingCount = 2
m_rgpthrPendingSignalings = ([0] = 0x00007f68541d4820, [1] = 0x00007f683000c480, [2] = 0x00007f68541d4820, [3] = 0x00007f684828d4c0, [4] = 0x00007f68541d4820, [5] = 0x00007f6830002cf0, [6] = 0x00007f6830005040, [7] = 0x00007f682c002e00, [8] = 0x00007f6830005040, [9] = 0x0000000000000000)
The 2 threads to be notified are:
(lldb) p ((CPalThread*) 0x00007f683000c480)->m_threadId
(SIZE_T) $40 = 14038
(lldb) p ((CPalThread*) 0x00007f68541d4820)->m_threadId
(SIZE_T) $41 = 3403
These thread must have been suspended due to GC. Thread 3403 was still in waiting state, while Thread id 14038 is thread #1, which hit the AV (the managed call stack couldn’t display for this thread for some reason).
(lldb) thread select 1

thread #1: tid = 0, 0x00007f68f8beff53 libcoreclr.soJIT_CheckedWriteBarrier_End + 3, name = 'dnx', stop reason = signal SIGSEGV   frame #0: 0x00007f68f8beff53 libcoreclr.soJIT_CheckedWriteBarrier_End + 3
-> 0x7f68f8beff53 <JIT_CheckedWriteBarrier_End+3>: movq   %rcx, (%rdi)
(lldb) register read rdi
rdi = 0x00007f686794dfc0

If examining the address in GDB, it said couldn’t access.
(gdb) x 0x7f686794dfc0
0x7f686794dfc0: Cannot access memory at address 0x7f686794dfc0
If you compare this address with the GC heaps, it’s beyond Gen0, and not in LOH as well. It makes me guessing that it tried to access some memory just released by GC.
It sounds something related to GC behavior, or we were trying to access some object without proper refcount or pin.

@halter73

@muratg I don't think this should still be in the 1.0.0 milestone. There is not stack trace for the AV. No AccessViolationException (maybe this was a first chance exception). Kestrel classes are nowhere on the stack that is provided.
There was also a GC related fix made since this report that could be related.
Unless we can reproduce this issue again, I would close.

Closing. If you have a repro, refile please.


DSD-397: DatePicker styling

Fixes JIRA ticket DSD-397
This PR does the following:

Updates the styling for the DatePicker element.
Most updates are for the React DatePicker package's popup calendar that changes the default blue theme to a black theme. This is mostly for selected values in the popup calendar.

Note: This is wrapped in a FormRow and FormField to follow DS field styling. Because there is an additional label for the date range type, it may look awkward.
With date range additional legend label visible:

With date range additional legend label not visible:

How has this been tested?
In Storybook.
Checklist:

[ ] I have updated the Storybook documentation accordingly.
[ ] All new and existing tests passed.

Front End Review:

[ ] View the example in Storybook

Tugboat has finished building the preview for this pull request!
Link:

https://pr638-5pxurqk8s0lenopqiirjehhlz28asnak.tugboat.qa

Dashboard:

https://dashboard.tugboat.qa/611c3626378c5fda36828706


METRON-253: Reloading parser configurations from zookeeper doesn't call init()

This results in a NPE if you do not specify an output column (this output column gets inferred as part of init())
To validate this:

Get a running instance of metron
Run /usr/metron/0.2.0BETA/bin/zk_load_configs.sh -m PUSH -i /usr/metron/0.2.0BETA/config/zookeeper -z node1:2181
Wait a full 2 minutes
Check the parser_error topic via the kafka console consumer and ensure you don't see any weird NPEs

The problem here is that init() is not getting run on the sensor parser config, so some syntactic sugar in the FieldTransformer isn't getting updated.  Specifically, if you only specify input and not output, then it will NPE.

+1

+1


CUDA out of memory, but there seems to be enough memory to train 70B

Thank you for your wonderful work!
Describe
CUDA out of memory.
I'm fine-tuning the llama-2-70B using 3 sets of machines containing 8*A100s (40G), and this error reported at first seemed like it should be an out-of-memory issue, but a large enough amount of memory has been used in the calculations. So it's not clear exactly why the error is being reported.
System info

OS: Ubuntu 20.04.6 LTS
Configured as 3 groups with 8*A100 graphics cards (total of 24 A100-40G graphics cards)
Python = 3.10

deepspeed
Run it on each of the three machines:
deepspeed --num_gpus 8
--num_node 3
--master_addr <IP_ADDRESS> \
--master_port 9901
--hostfile /mnt/download/configs/hostfile.txt src/train_bash.py
--deepspeed /mnt/git/LLaMA-Efficient-Tuning/src/ds_config.json
--stage sft
--model_name_or_path /mnt/model/Llama-2-70b-hf
--max_source_length 1024
--max_target_length 1024
--do_train
--dataset alpaca_gpt4_zh
--template vanilla
--finetuning_type lora
--lora_target q_proj,v_proj
--output_dir /mnt/output/70B/
--overwrite_cache
--per_device_train_batch_size 16
--gradient_accumulation_steps 4
--lr_scheduler_type cosine
--logging_steps 10
--save_steps 1000
--learning_rate 5e-5
--num_train_epochs 1
--plot_loss
--ddp_find_unused_parameters False
--template llama2
--fp16
ds_config.json(I used the zero-2 (deepspeed) profile given out in the sample):
{
"train_micro_batch_size_per_gpu": "auto",
"gradient_accumulation_steps": "auto",
"gradient_clipping": "auto",
"zero_allow_untested_optimizer": true,
"fp16": {
"enabled": "auto",
"loss_scale": 0,
"initial_scale_power": 16,
"loss_scale_window": 1000,
"hysteresis": 2,
"min_loss_scale": 1
},
"zero_optimization": {
"stage": 2,
"allgather_partitions": true,
"allgather_bucket_size": 5e8,
"reduce_scatter": true,
"reduce_bucket_size": 5e8,
"overlap_comm": false,
"contiguous_gradients": true
}
}
hostfile.txt
<IP_ADDRESS> slots=8
<IP_ADDRESS> slots=8
<IP_ADDRESS> slots=8
report output
<IP_ADDRESS>: /mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/transformers/optimization.py:411: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set no_deprecation_warning=True to disable this warning
<IP_ADDRESS>:   warnings.warn(
Running tokenizer on dataset (num_proc=8): 100%|██████████| 48818/48818 [00:15<00:00, 3063.90 examples/s]
Running tokenizer on dataset (num_proc=8): 100%|██████████| 48818/48818 [00:16<00:00, 3049.33 examples/s]
<IP_ADDRESS>: Traceback (most recent call last):
<IP_ADDRESS>:   File "/mnt/git/LLaMA-Efficient-Tuning/src/train_bash.py", line 14, in
<IP_ADDRESS>:     main()
<IP_ADDRESS>:   File "/mnt/git/LLaMA-Efficient-Tuning/src/train_bash.py", line 5, in main
<IP_ADDRESS>:     run_exp()
<IP_ADDRESS>:   File "/mnt/git/LLaMA-Efficient-Tuning/src/llmtuner/tuner/tune.py", line 26, in run_exp
<IP_ADDRESS>:     run_sft(model_args, data_args, training_args, finetuning_args, generating_args, callbacks)
<IP_ADDRESS>:   File "/mnt/git/LLaMA-Efficient-Tuning/src/llmtuner/tuner/sft/workflow.py", line 63, in run_sft
<IP_ADDRESS>:     train_result = trainer.train(resume_from_checkpoint=training_args.resume_from_checkpoint)
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/transformers/trainer.py", line 1539, in train
<IP_ADDRESS>:     return inner_training_loop(
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/transformers/trainer.py", line 1656, in _inner_training_loop
<IP_ADDRESS>:     model, self.optimizer = self.accelerator.prepare(self.model, self.optimizer)
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/accelerate/accelerator.py", line 1266, in prepare
<IP_ADDRESS>:     result = self._prepare_deepspeed(*args)
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/accelerate/accelerator.py", line 1600, in _prepare_deepspeed
<IP_ADDRESS>:     engine, optimizer, _, lr_scheduler = deepspeed.initialize(**kwargs)
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/deepspeed/init.py", line 171, in initialize
<IP_ADDRESS>:     engine = DeepSpeedEngine(args=args,
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 260, in init
<IP_ADDRESS>:     self._configure_distributed_model(model)
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 1068, in _configure_distributed_model
<IP_ADDRESS>:     self.module.to(self.device)
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1145, in to
<IP_ADDRESS>:     return self._apply(convert)
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/torch/nn/modules/module.py", line 797, in _apply
<IP_ADDRESS>:     module._apply(fn)
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/torch/nn/modules/module.py", line 797, in _apply
<IP_ADDRESS>:     module._apply(fn)
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/torch/nn/modules/module.py", line 797, in _apply
<IP_ADDRESS>:     module._apply(fn)
<IP_ADDRESS>:   [Previous line repeated 4 more times]
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/torch/nn/modules/module.py", line 820, in _apply
<IP_ADDRESS>:     param_applied = fn(param)
<IP_ADDRESS>:   File "/mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1143, in convert
<IP_ADDRESS>:     return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking)
<IP_ADDRESS>: torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 448.00 MiB (GPU 0; 39.45 GiB total capacity; 38.36 GiB already allocated; 194.31 MiB free; 38.36 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
<IP_ADDRESS>: input_ids:
<IP_ADDRESS>: [1, 518, 25580, 29962, ……
<IP_ADDRESS>: /mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/transformers/optimization.py:411: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set no_deprecation_warning=True to disable this warning
<IP_ADDRESS>:   warnings.warn(
<IP_ADDRESS>: /mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/transformers/optimization.py:411: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set no_deprecation_warning=True to disable this warning
<IP_ADDRESS>:   warnings.warn(
<IP_ADDRESS>: /mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/transformers/optimization.py:411: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set no_deprecation_warning=True to disable this warning
<IP_ADDRESS>:   warnings.warn(
<IP_ADDRESS>: /mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/transformers/optimization.py:411: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set no_deprecation_warning=True to disable this warning
<IP_ADDRESS>:   warnings.warn(
<IP_ADDRESS>: /mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/transformers/optimization.py:411: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set no_deprecation_warning=True to disable this warning
<IP_ADDRESS>:   warnings.warn(
<IP_ADDRESS>: /mnt/anaconda/envs/llama_etuning/lib/python3.10/site-packages/transformers/optimization.py:411: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set no_deprecation_warning=True to disable this warning
<IP_ADDRESS>:   warnings.warn(
<IP_ADDRESS>: [2023-08-31 11:58:27,249] [INFO] [launch.py:315:sigkill_handler] Killing subprocess 1612505
<IP_ADDRESS>: [2023-08-31 11:58:27,249] [INFO] [launch.py:315:sigkill_handler] Killing subprocess 1612506
<IP_ADDRESS>: [2023-08-31 11:58:27,565] [INFO] [launch.py:315:sigkill_handler] Killing subprocess 1612507

Hi, A100 40GB is insufficient to fine-tune a 70B model.

Thank you for your prompt response!

I suspect that my calculations are wrong, can I draw on your reasoning for determining insufficiency?
For 3*8=24 A100 (40G), what is the approximate video card configuration for the 70B configuration for this project, if not sufficient?

if QLoRA's 4/8 bit training method is used (I saw the previous issue mentioning that it can't be used in the form of deepspeed, and I plan to try it with accelerate), might there be a way to do it without OOM errors?
Thanks again, I'll follow up on this project!

Hi, A100 40GB is insufficient to fine-tune a 70B model.

Thank you for your prompt response!

I suspect that my calculations are wrong, can I draw on your reasoning for determining insufficiency?
For 3*8=24 A100 (40G), what is the approximate video card configuration for the 70B configuration for this project, if not sufficient?

if QLoRA's 4/8 bit training method is used (I saw the previous issue mentioning that it can't be used in the form of deepspeed, and I plan to try it with accelerate), might there be a way to do it without OOM errors?
Thanks again, I'll follow up on this project!

Hi, A100 40GB is insufficient to fine-tune a 70B model.

Thank you for your prompt response!

I wonder if my calculations are wrong, can I draw on your reasoning for determining insufficiency?
For 3*8=24 A100 (40G), if it is not sufficient, what is the approximate configuration of 70B allocated for this project?

if QLoRA's 4/8 bit training method is used (I saw the previous issue mentioning that it can't be used in the form of deepspeed, and I was going to try it with accelerate), is there probably a way to do it without OOM errors?
Thanks again, I'll follow up on this project!

A 70B model requires at least 140GB of memory on a single GPU in fp16 precision without model parallel since you are using DeepSpeed ZeRO-2. Alternatively, you could try DeepSpeed ZeRO stage 3 to train a 70B model.
QLoRA cannot avoid the OOM error because a 70B model requires 50GB of memory in 4-bit precision, which is insufficient for an A100 40GB GPU.

A 70B model requires at least 140GB of memory on a single GPU in fp16 precision without model parallel since you are using DeepSpeed ZeRO-2. Alternatively, you could try DeepSpeed ZeRO stage 3 to train a 70B model.
QLoRA cannot avoid the OOM error because a 70B model requires 50GB of memory in 4-bit precision, which is insufficient for an A100 40GB GPU.

感谢您的专业回答！我之前对于内存足够的想法显然建立在总体，没有充分考虑单卡需求的细节。
在参考了别人的issue思考后，使用多卡+参数并行的微调训练方法目前可以弥补40GB显存在上述您指出的训练内存不足问题。
但同时引发了新的问题：多卡训练速度慢于单卡训练

1.问题描述
继续微调Llama-2-70B的过程中发现问题：2节点共16卡（2*8*A100 40GB），大大慢于1节点8卡的训练速度，主要是观察出前者训练总时间大大高于后者。
 服务器配置及系统、训练参数
a. 服务器配置：每节点8卡A100 PCIE（非NVLink） 显存40GB, CPU内存600GB，节点间通信带宽是25G，超过万兆，但不是IB或RDMA
b. 系统参数：

OS: Ubuntu 20.04.6 LTS
Python = 3.10

c. 训练参数(出自训练输出)
-16卡训练参数：
***** Running training *****
Num examples = 56,318
Num Epochs = 2
Instantaneous batch size per device = 8
Total train batch size (w. parallel, distributed & accumulation) = 128
Gradient Accumulation steps = 1
Total optimization steps = 880
Number of trainable parameters = 16,384,000

-8卡训练参数
 ***** Running training *****
Num examples = 56,318
Num Epochs = 2
Instantaneous batch size per device = 8
Total train batch size (w. parallel, distributed & accumulation) = 64
Gradient Accumulation steps = 1
Total optimization steps = 1,760
Number of trainable parameters = 16,384,000

4. 问题截图
8卡训练：使用相同数据集，等待一段时间稳定后，预计时间接近52小时10分钟

16卡训练：使用相同数据集，等待一段时间稳定后，预计时间接近79小时31分钟

期待您的回复！

考虑到机器之间的通信速度，这种速度减慢是正常现象

是的，目前看来训练受限于通信速度。
请问这种问题有可能通过修改配置和参数来解决吗？

没有很好的解决办法

好的，感谢


Query of the form 'a.0.b' : {$exists:false} doesn't work as expected

for {'a':[1,2]}, expected to return the document, returns nothing

Fixed


[FLINK-29561] Add job id in the cleanup job failed message.

What is the purpose of the change
Add the jobID in the session job cleanup error message.

This will be a bit useful for us to delete it manually by Flink TM restful API

Brief change log
Add the jobID in the session job cleanup error message
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (no)
The public API, i.e., is any changes to the CustomResourceDescriptors: (no)
Core observer or reconciler logic that is regularly executed: (no)

Documentation

Does this pull request introduce a new feature? (no)

LGTM


Automated cherry pick of #8889: bugfix: wait put host offline success

Cherry pick of #8889 on release/3.4.
#8889: bugfix: wait put host offline success

Codecov Report

Merging #8891 (9d2145d) into release/3.4 (02bcce1) will decrease coverage by 2.64%.
The diff coverage is 2.59%.

@@              Coverage Diff               @@
##           release/3.4   #8891      +/-   ##
==============================================
- Coverage         6.22%   3.57%   -2.65%
==============================================
  Files              759     304     -455
  Lines           117145   62662   -54483
==============================================
- Hits              7289    2241    -5048
+ Misses          109197   60265   -48932
+ Partials           659     156     -503

Flag
Coverage Δ

aFlag
3.57% <2.59%> (-2.65%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

pkg/appsrv/stats.go
0.00% <0.00%> (ø)

pkg/cloudcommon/notifyclient/events.go
0.00% <0.00%> (ø)

pkg/cloudcommon/notifyclient/notify.go
1.80% <0.00%> (-0.43%)
:arrow_down:

pkg/compute/models/buckets.go
1.10% <0.00%> (+0.03%)
:arrow_up:

pkg/compute/models/cachedimages.go
1.73% <0.00%> (-0.08%)
:arrow_down:

pkg/compute/models/capabilities.go
0.00% <0.00%> (ø)

pkg/compute/models/cloudaccounts.go
0.48% <0.00%> (-4.66%)
:arrow_down:

pkg/compute/models/cloudregionresource.go
0.00% <0.00%> (ø)

pkg/compute/models/cloudregions.go
1.54% <0.00%> (-0.04%)
:arrow_down:

pkg/compute/models/dbinstance_backups.go
2.24% <0.00%> (-0.55%)
:arrow_down:

... and 473 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9c2cc66...9d2145d. Read the comment docs.