az vmss update --capacity-reservation-group  exception (preview)

Describe the bug
I'm trying to associate a capacity reservation group to a VMSS but i got an exception.
This command is in preview but I wanted to report the behavior as I can't do that.
Related command
az vmss update --capacity-reservation-group
Errors
PS /home/adm> az vmss update --name p00002-pt-az3 --resource-group pr-asr-pgs-prd --capacity-reservation-group /subscriptions/<silenced>/resourceGroups/PR-ASR-PGS-PRD/providers/Microsoft.Compute/capacityReservationGroups/crg-az3
Argument '--capacity-reservation-group' is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus
The command failed with an unexpected error. Here is the traceback:
'NoneType' object has no attribute 'capacity_reservation'
Traceback (most recent call last):
  File "/usr/lib64/az/lib/python3.9/site-packages/knack/cli.py", line 233, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 663, in execute
    raise ex
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 697, in _run_job
    result = cmd_copy(params)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 333, in __call__
    return self.handler(*args, **kwargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/command_operation.py", line 240, in handler
    result = cached_put(self.cmd, setter, **setterargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 452, in cached_put
    return _put_operation()
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 446, in _put_operation
    result = operation(**kwargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/command_modules/vm/custom.py", line 4002, in update_vmss
    vmss.virtual_machine_profile.capacity_reservation = capacity_reservation
AttributeError: 'NoneType' object has no attribute 'capacity_reservation'
To check existing issues, please visit: https://github.com/Azure/azure-cli/issues
PS /home/adm>

Issue script & Debug output
PS /home/adm> az vmss update --name p00002-pt-az3 --resource-group pr-asr-pgs-prd --capacity-reservation-group /subscriptions/<silenced>/resourceGroups/PR-ASR-PGS-PRD/providers/Microsoft.Compute/capacityReservationGroups/crg-az3 --debug
cli.knack.cli: Command arguments: ['vmss', 'update', '--name', 'p00002-pt-az3', '--resource-group', 'pr-asr-pgs-prd', '--capacity-reservation-group', '/subscriptions/<silenced>/resourceGroups/PR-ASR-PGS-PRD/providers/Microsoft.Compute/capacityReservationGroups/crg-az3', '--debug']
cli.knack.cli: __init__ debug log:
Enable color in terminal.
cli.knack.cli: Event: Cli.PreExecute []
cli.knack.cli: Event: CommandParser.OnGlobalArgumentsCreate [<function CLILogging.on_global_arguments at 0x7fbd1c0a01f0>, <function OutputProducer.on_global_arguments at 0x7fbd1bfbad30>, <function CLIQuery.on_global_arguments at 0x7fbd1bf52310>]
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableCreate []
cli.azure.cli.core: Modules found from index for 'vmss': ['azure.cli.command_modules.vm']
cli.azure.cli.core: Loading command modules:
cli.azure.cli.core: Name                  Load Time    Groups  Commands
cli.azure.cli.core: vm                        0.176        59       237
cli.azure.cli.core: Total (1)                 0.176        59       237
cli.azure.cli.core: These extensions are not installed and will be skipped: ['azext_next']
cli.azure.cli.core: Loading extensions:
cli.azure.cli.core: Name                  Load Time    Groups  Commands  Directory
cli.azure.cli.core: ai-examples               0.075         1         1  /usr/lib/python3.9/site-packages/azure-cli-extensions/ai-examples
cli.azure.cli.core: Total (1)                 0.075         1         1
cli.azure.cli.core: Loaded 60 groups, 238 commands.
cli.azure.cli.core: Found a match in the command table.
cli.azure.cli.core: Raw command  : vmss update
cli.azure.cli.core: Command table: vmss update
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableTruncate [<function AzCliLogging.init_command_file_logging at 0x7fbd1b3f6430>]
cli.azure.cli.core.azlogging: metadata file logging enabled - writing logs to '/home/adm/.azure/commands/2023-10-04.14-20-21.vmss_update.389.log'.
az_command_data_logger: command args: vmss update --name {} --resource-group {} --capacity-reservation-group {} --debug
cli.knack.cli: Event: CommandInvoker.OnPreArgumentLoad [<function register_global_subscription_argument.<locals>.add_subscription_parameter at 0x7fbd1b3a0040>]
cli.knack.cli: Event: CommandInvoker.OnPostArgumentLoad []
cli.knack.cli: Event: CommandInvoker.OnPostCommandTableCreate [<function register_ids_argument.<locals>.add_ids_arguments at 0x7fbd1b3d60d0>, <function register_cache_arguments.<locals>.add_cache_arguments at 0x7fbd1b35fee0>]
cli.knack.cli: Event: CommandInvoker.OnCommandTableLoaded []
cli.knack.cli: Event: CommandInvoker.OnPreParseArgs []
cli.knack.cli: Event: CommandInvoker.OnPostParseArgs [<function OutputProducer.handle_output_argument at 0x7fbd1bfbadc0>, <function CLIQuery.handle_query_parameter at 0x7fbd1bf523a0>, <function register_ids_argument.<locals>.parse_ids_arguments at 0x7fbd1b35fe50>]
Argument '--capacity-reservation-group' is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus
cli.azure.cli.core.commands.client_factory: Getting management service client client_type=ComputeManagementClient
urllib3.connectionpool: Starting new HTTP connection (1): localhost:50342
urllib3.connectionpool: http://localhost:50342 "POST /oauth2/token HTTP/1.1" 200 4106
msrestazure.azure_active_directory: MSI: Retrieving a token from http://localhost:50342/oauth2/token, with payload {'resource': 'https://management.core.windows.net/'}
cli.azure.cli.core.auth.adal_authentication: MSIAuthenticationWrapper.get_token: scopes=('https://management.core.windows.net//.default',), kwargs={}
urllib3.connectionpool: Starting new HTTP connection (1): localhost:50342
urllib3.connectionpool: http://localhost:50342 "POST /oauth2/token HTTP/1.1" 200 4106
msrestazure.azure_active_directory: MSI: Retrieving a token from http://localhost:50342/oauth2/token, with payload {'resource': 'https://management.core.windows.net/'}
cli.azure.cli.core.auth.adal_authentication: Normalize expires_on: '1696512356' -><PHONE_NUMBER>
cli.azure.cli.core.sdk.policies: Request URL: 'https://management.azure.com/subscriptions/<silenced>/resourceGroups/pr-asr-pgs-prd/providers/Microsoft.Compute/virtualMachineScaleSets/p00002-pt-az3?api-version=2023-03-01'
cli.azure.cli.core.sdk.policies: Request method: 'GET'
cli.azure.cli.core.sdk.policies: Request headers:
cli.azure.cli.core.sdk.policies:     'Accept': 'application/json'
cli.azure.cli.core.sdk.policies:     'x-ms-client-request-id': '2692bc94-62c1-11ee-8cb2-b2126e3c0c8f'
cli.azure.cli.core.sdk.policies:     'CommandName': 'vmss update'
cli.azure.cli.core.sdk.policies:     'ParameterSetName': '--name --resource-group --capacity-reservation-group --debug'
cli.azure.cli.core.sdk.policies:     'User-Agent': 'AZURECLI/2.53.0 (RPM) azsdk-python-azure-mgmt-compute/30.0.0 Python/3.9.14 (Linux-5.4.0-1109-azure-x86_64-with-glibc2.35) cloud-shell/1.0'
cli.azure.cli.core.sdk.policies:     'Authorization': '*****'
cli.azure.cli.core.sdk.policies: Request body:
cli.azure.cli.core.sdk.policies: This request has no body
urllib3.connectionpool: Starting new HTTPS connection (1): management.azure.com:443
urllib3.connectionpool: https://management.azure.com:443 "GET /subscriptions/<silenced>/resourceGroups/pr-asr-pgs-prd/providers/Microsoft.Compute/virtualMachineScaleSets/p00002-pt-az3?api-version=2023-03-01 HTTP/1.1" 200 None
cli.azure.cli.core.sdk.policies: Response status: 200
cli.azure.cli.core.sdk.policies: Response headers:
cli.azure.cli.core.sdk.policies:     'Cache-Control': 'no-cache'
cli.azure.cli.core.sdk.policies:     'Pragma': 'no-cache'
cli.azure.cli.core.sdk.policies:     'Transfer-Encoding': 'chunked'
cli.azure.cli.core.sdk.policies:     'Content-Type': 'application/json; charset=utf-8'
cli.azure.cli.core.sdk.policies:     'Content-Encoding': 'gzip'
cli.azure.cli.core.sdk.policies:     'Expires': '-1'
cli.azure.cli.core.sdk.policies:     'Vary': 'Accept-Encoding'
cli.azure.cli.core.sdk.policies:     'x-ms-ratelimit-remaining-resource': 'Microsoft.Compute/GetVMScaleSet3Min;854,Microsoft.Compute/GetVMScaleSet30Min;5509'
cli.azure.cli.core.sdk.policies:     'Strict-Transport-Security': 'max-age=31536000; includeSubDomains'
cli.azure.cli.core.sdk.policies:     'x-ms-request-id': '63d447fc-df5c-4c67-b3dd-0bf4aafc813a'
cli.azure.cli.core.sdk.policies:     'Server': 'Microsoft-HTTPAPI/2.0, Microsoft-HTTPAPI/2.0'
cli.azure.cli.core.sdk.policies:     'x-ms-ratelimit-remaining-subscription-reads': '11999'
cli.azure.cli.core.sdk.policies:     'x-ms-correlation-request-id': '4f528462-f0da-4833-9eae-d0b1f0e07f2c'
cli.azure.cli.core.sdk.policies:     'x-ms-routing-request-id': 'WESTEUROPE:20231004T142021Z:4f528462-f0da-4833-9eae-d0b1f0e07f2c'
cli.azure.cli.core.sdk.policies:     'X-Content-Type-Options': 'nosniff'
cli.azure.cli.core.sdk.policies:     'Date': 'Wed, 04 Oct 2023 14:20:21 GMT'
cli.azure.cli.core.sdk.policies: Response content:
cli.azure.cli.core.sdk.policies: {
  "name": "p00002-pt-az3",
  "id": "/subscriptions/<silenced>/resourceGroups/pr-asr-pgs-prd/providers/Microsoft.Compute/virtualMachineScaleSets/p00002-pt-az3",
  "type": "Microsoft.Compute/virtualMachineScaleSets",
  "location": "francecentral",
  "tags": {
    "app-name": "pgs",
    "atemi": "4848",
    "autoshutdownschedule": "noautoshutdown",
    "build-tool": "iac",
    "build_info_demande": "",
    "build_info_eul": "",
    "builder": "sco",
    "criticality": "standard",
    "data-classification": "c3",
    "datadog-monitored": "no",
    "disablestartandstop": "none",
    "environment": "prd",
    "expo": "prv",
    "owner": "dea",
    "routing-hypervision": "none"
  },
  "properties": {
    "singlePlacementGroup": false,
    "orchestrationMode": "Flexible",
    "provisioningState": "Succeeded",
    "uniqueId": "a6f7551a-0923-453a-9489-a789eb9eb012",
    "platformFaultDomainCount": 1,
    "constrainedMaximumCapacity": false
  },
  "zones": [
    "3"
  ]
}
cli.azure.cli.core.commands.client_factory: Getting management service client client_type=ComputeManagementClient
urllib3.connectionpool: Starting new HTTP connection (1): localhost:50342
urllib3.connectionpool: http://localhost:50342 "POST /oauth2/token HTTP/1.1" 200 4106
msrestazure.azure_active_directory: MSI: Retrieving a token from http://localhost:50342/oauth2/token, with payload {'resource': 'https://management.core.windows.net/'}
cli.azure.cli.core.azclierror: Traceback (most recent call last):
  File "/usr/lib64/az/lib/python3.9/site-packages/knack/cli.py", line 233, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 663, in execute
    raise ex
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 697, in _run_job
    result = cmd_copy(params)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 333, in __call__
    return self.handler(*args, **kwargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/command_operation.py", line 240, in handler
    result = cached_put(self.cmd, setter, **setterargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 452, in cached_put
    return _put_operation()
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 446, in _put_operation
    result = operation(**kwargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/command_modules/vm/custom.py", line 4002, in update_vmss
    vmss.virtual_machine_profile.capacity_reservation = capacity_reservation
AttributeError: 'NoneType' object has no attribute 'capacity_reservation'

cli.azure.cli.core.azclierror: The command failed with an unexpected error. Here is the traceback:
az_command_data_logger: The command failed with an unexpected error. Here is the traceback:
cli.azure.cli.core.azclierror: 'NoneType' object has no attribute 'capacity_reservation'
Traceback (most recent call last):
  File "/usr/lib64/az/lib/python3.9/site-packages/knack/cli.py", line 233, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 663, in execute
    raise ex
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 697, in _run_job
    result = cmd_copy(params)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 333, in __call__
    return self.handler(*args, **kwargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/command_operation.py", line 240, in handler
    result = cached_put(self.cmd, setter, **setterargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 452, in cached_put
    return _put_operation()
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 446, in _put_operation
    result = operation(**kwargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/command_modules/vm/custom.py", line 4002, in update_vmss
    vmss.virtual_machine_profile.capacity_reservation = capacity_reservation
AttributeError: 'NoneType' object has no attribute 'capacity_reservation'
az_command_data_logger: 'NoneType' object has no attribute 'capacity_reservation'
Traceback (most recent call last):
  File "/usr/lib64/az/lib/python3.9/site-packages/knack/cli.py", line 233, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 663, in execute
    raise ex
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 697, in _run_job
    result = cmd_copy(params)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 333, in __call__
    return self.handler(*args, **kwargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/command_operation.py", line 240, in handler
    result = cached_put(self.cmd, setter, **setterargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 452, in cached_put
    return _put_operation()
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 446, in _put_operation
    result = operation(**kwargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/command_modules/vm/custom.py", line 4002, in update_vmss
    vmss.virtual_machine_profile.capacity_reservation = capacity_reservation
AttributeError: 'NoneType' object has no attribute 'capacity_reservation'
To check existing issues, please visit: https://github.com/Azure/azure-cli/issues
cli.knack.cli: Event: Cli.PostExecute [<function AzCliLogging.deinit_cmd_metadata_logging at 0x7fbd1b3f6670>]
az_command_data_logger: exit code: 1
cli.__main__: Command ran in 0.831 seconds (init: 0.128, invoke: 0.703)
telemetry.main: Begin splitting cli events and extra events, total events: 1
telemetry.client: Accumulated 0 events. Flush the clients.
telemetry.main: Finish splitting cli events and extra events, cli events: 1
telemetry.save: Save telemetry record of length 7252 in cache
telemetry.main: Begin creating telemetry upload process.
telemetry.process: Creating upload process: "/usr/bin/python3.9 /usr/lib/az/lib/python3.9/site-packages/azure/cli/telemetry/__init__.py /home/adm/.azure"
telemetry.process: Return from creating process
telemetry.main: Finish creating telemetry upload process.
PS /home/adm>

Expected behavior
No exception
VMSS associated to capacity reservation group
Environment Summary
Azure cloud shell
PS /home/adm> az version
{
  "azure-cli": "2.53.0",
  "azure-cli-core": "2.53.0",
  "azure-cli-telemetry": "1.1.0",
  "extensions": {
    "ai-examples": "0.2.5",
    "ml": "2.20.0",
    "ssh": "2.0.1"
  }
}

Additional context
No response

Thank you for opening this issue, we will look into it.

@TiTi Hi, thank you for reporting this issue. I tried to replicate the error you described, but I was not able to. I noticed that the information of the vmss fetched looks strange.

cli.azure.cli.core.sdk.policies: Response content:
cli.azure.cli.core.sdk.policies: {
"name": "p00002-pt-az3",
"id": "/subscriptions//resourceGroups/pr-asr-pgs-prd/providers/Microsoft.Compute/virtualMachineScaleSets/p00002-pt-az3",
"type": "Microsoft.Compute/virtualMachineScaleSets",
"location": "francecentral",
"tags": {
"app-name": "pgs",
"atemi": "4848",
"autoshutdownschedule": "noautoshutdown",
"build-tool": "iac",
"build_info_demande": "",
"build_info_eul": "",
"builder": "sco",
"criticality": "standard",
"data-classification": "c3",
"datadog-monitored": "no",
"disablestartandstop": "none",
"environment": "prd",
"expo": "prv",
"owner": "dea",
"routing-hypervision": "none"
},
"properties": {
"singlePlacementGroup": false,
"orchestrationMode": "Flexible",
"provisioningState": "Succeeded",
"uniqueId": "a6f7551a-0923-453a-9489-a789eb9eb012",
"platformFaultDomainCount": 1,
"constrainedMaximumCapacity": false
},
"zones": [
"3"
]
}

Could you please share with me how you created the vmss? This might help us identify the root cause of the problem. I appreciate your cooperation.

Hello @ReaNAiveD
What's strange?
The VMSS was created with 0 instance count. And then we added some machines inside by creating them.
We did not use manual (or automatic) scaling.
In fact it was existing machines (that were not in a scaleset) we had to recreate with the existing disks/nic so that they end up in the scaleset.
We do that for max spreading and ability to do capacity reservation in Azure Site Recovery.
The vmss is created through terraform 1.4.6 with azurerm provider 3.75.0
Basically here is the output of the terraform plan:
17:30:45    # module.vmss_new["pt-az3"].azurerm_orchestrated_virtual_machine_scale_set.orchestrated_vmss[0] will be created
17:30:45    + resource "azurerm_orchestrated_virtual_machine_scale_set" "orchestrated_vmss" {
17:30:45        + extension_operations_enabled  = (known after apply)
17:30:45        + extensions_time_budget        = "PT1H30M"
17:30:45        + id                            = (known after apply)
17:30:45        + instances                     = 0
17:30:45        + location                      = "francecentral"
17:30:45        + max_bid_price                 = -1
17:30:45        + name                          = (known after apply)
17:30:45        + platform_fault_domain_count   = 1
17:30:45        + priority                      = "Regular"
17:30:45        + resource_group_name           = "pr-asr-pgs-prd"
17:30:45        + single_placement_group        = false
17:30:45        + tags                          = {
17:30:45            + "app-name"             = "pgs"
17:30:45            + "atemi"                = "4848"
17:30:45            + "autoshutdownschedule" = "noautoshutdown"
17:30:45            + "build-tool"           = "iac"
17:30:45            + "build_info_demande"   = ""
17:30:45            + "build_info_eul"       = ""
17:30:45            + "builder"              = "sco"
17:30:45            + "criticality"          = "standard"
17:30:45            + "data-classification"  = "c3"
17:30:45            + "datadog-monitored"    = "no"
17:30:45            + "disablestartandstop"  = "none"
17:30:45            + "environment"          = "prd"
17:30:45            + "expo"                 = "prv"
17:30:45            + "owner"                = "dea"
17:30:45            + "routing-hypervision"  = "none"
17:30:45          }
17:30:45        + unique_id                     = (known after apply)
17:30:45        + zone_balance                  = false
17:30:45        + zones                         = [
17:30:45            + "3",
17:30:45          ]
17:30:45
17:30:45        + source_image_reference {
17:30:45            + offer     = "WindowsServer"
17:30:45            + publisher = "MicrosoftWindowsServer"
17:30:45            + sku       = "2019-Datacenter"
17:30:45            + version   = "latest"
17:30:45          }
17:30:45      }
17:30:45

Note that since then we found this documentation: https://learn.microsoft.com/en-us/azure/virtual-machines/capacity-reservation-associate-virtual-machine-scale-set-flex#associate-a-new-virtual-machine-scale-set-to-a-capacity-reservation-group
Basically saying the association should be made at vmss creation.
We added that to our vmss creation since.
(but we still end up with unability to associate VM declared in ASR with the reservation)

@grizzlytheodore Hi, please take a look at this issue. I found that there is no virtualMachineProfile in the property of the vmss fetched by GET request. Is this by design or a bug?

Hi team - It seems like you are using Azure Site Recovery, please correct me if I'm wrong. Capacity reservation in ASR for VMSS is not yet supported.

@TiTi - I will close this one as the scenario is by design and not supported yet.  Please reopen if the issue isn't addressed.


Where did you get the LilyGoWatch.h library?

I'd love to get this up and running...looks really cool

The first line of the README.md file says "First ensure that you have installed the TTGO_TWatch_Library" - that's where the LilyGoWatch.h file is defined.


Support lookup functions in the helm template calls

Describe the problem/challenge you have
More charts are starting to implement the helm lookup function which will check existing secrets for certain values and populate them -- this provides a convenience and form of error checking in certain charts to make sure values are populated and correct.  This creates problems for kapp which expects the helm template calls to not interact with existing cluster data.
Describe the solution you'd like
Allow the helm template call to use the service account that exists for the App CR to potentially get some data off the cluster.  This would require adding --dry-run=server to the helm template command and providing a kubeconfig that would be accessible to the client.
Anything else you would like to add:
I don't like this, but helm chart authors are starting to implement this function in a way that breaks certain functionality if it's not used.

Vote on this request
This is an invitation to the community to vote on issues, to help us prioritize our backlog. Use the "smiley face" up to the right of this comment to vote.
👍 "I would like to see this addressed as soon as possible"
👎 "There are other more important things to focus on right now"
We are also happy to receive and review Pull Requests if you want to help working on this issue.

Example: the Bitnami Redis chart won't let you use an existing secret anymore as a values, since if you want to use an existing secret it will lookup the value in that secret and then use it in the rendering instead of just letting you put in the reference to the secret.  See here: Bitnami Redis chart template


Update team-chat-member-api-changes.md

update doc to add references to TeamsInfo.GetPagedMembersAsync & TeamsInfo.GetMemberAsync API's.

Docs Build status updates of commit cf95994:
:clock10: Pending: waiting for processors (5 builds ahead of you)
:warning: Docs Build is busy, currently there are 5 builds ahead of this one, for more information you can view the Build queue graph on the Docs Portal.

Docs Build status updates of commit cf95994:
:warning: Validation status: warnings

File
Status
Preview URL
Details

msteams-platform/resources/team-chat-member-api-changes.md
:warning:Warning
View
Details

msteams-platform/resources/team-chat-member-api-changes.md

Line 48: [Warning] Link 'https://docs.microsoft.com/en-us/microsoftteams/platform/bots/how-to/get-teams-context?tabs=dotnet#fetching-the-roster-or-user-profile' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.
Line 49: [Warning] Link 'https://docs.microsoft.com/en-us/microsoftteams/platform/bots/how-to/get-teams-context?tabs=dotnet#get-single-member-details' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.
Line 49: [Warning] Link 'https://docs.microsoft.com/en-us/microsoftteams/platform/bots/how-to/get-teams-context?tabs=json#get-single-member-details' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit 37dc813:
:clock10: Pending: waiting for processors (5 builds ahead of you)
:warning: Docs Build is busy, currently there are 5 builds ahead of this one, for more information you can view the Build queue graph on the Docs Portal.

Docs Build status updates of commit a3f7384:
:warning: Validation status: warnings

File
Status
Preview URL
Details

msteams-platform/resources/team-chat-member-api-changes.md
:warning:Warning
View
Details

msteams-platform/resources/team-chat-member-api-changes.md

[Warning] Author ojchoudh cannot be recognized in GitHub.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit 5524d09:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

msteams-platform/resources/team-chat-member-api-changes.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit acd7751:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

msteams-platform/resources/team-chat-member-api-changes.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Timed Traffic Lights Not Saving/Loading

Possibly related to https://github.com/VictorPhilipp/Cities-Skylines-Traffic-Manager-President-Edition/issues/231, I've noticed that my timed traffic lights are not saving (which sucks because I spent a lot of time setting those up D: ). Unsure of what could be going wrong.

Please provide TMPE.log and savegame (via workshop share function is the best because I can see which dependent mods I need).
I've noticed that sometimes traffic light are not saved because of invalid segment relations.
I have no idea what is cause and it has to be checked.
(If you build this mod in FullDebug you will see detailed info for every operation in TMPE.log - on loading, saving game and manipulating traffic light and other stuff)

Apologies on my late response. I've been building it straight from source and using it casually from there, if that helps. Learning about the GlobalConfig and the debug switches, I did what any other smart person would do. Enabled every single one. Then played my game like that. :thinking: Was it a good idea? Absolutely. Was it actually a good idea? No, it was not. Let's just say I couldn't even get the level to load within ten minutes. So, I did the smart thing, and only enabled the ones I needed to (which was none, because none of the debug switches relate to this, for whatever reason). Here's your output logs! :)
New Game, Creating the Map, then Saving: TMPE.log
Loading: TMPE.log
And here's the save. I didn't use any custom mods other than TMPE, Unlimited Money, & Unlock All. I had some custom assets enabled, but I didn't use any so that shouldn't be a problem. Sorry I didn't publish it to the workshop, I just used so little mods I thought it would be easier to do this. And it's 12:30 AM lol.
TMPE Bugtesting.zip
*Notice how when you load the save, there's no timed traffic lights, even though clearly the first log shows me setting them up.
** I had to zip it due to GitHub's filetype limitations (I couldn't directly upload the .crp)

Did you removed any field/property or changed something in class Configuration?(TLM/State/Configuration.cs)
As you can see in TMPE.log (Loading log) you've added at line 329 - Error deserializing data: System.ArgumentException (type used to serialize has the same name but AFAIK it seems that is not the same as current version while loading)
It seems that you've changes something(might be related to your PR 😉  ) that prevents deserialization (process of reading savegame byte array chunk to create instance of Configuration class)

Sadly it seems I couldn't reproduce your issue with loading. Everything working perfectly fine no issues in log.
I can see you have added three Timed traffic lights. Look 😉

I've been testing attached savegame with my latest build as well as yours from PR. No issues 😃

Well that's very, very odd. I've noticed my game has a bunch of weird issues every once in a while. Is there any sort of cache you'd suggest I clear? GloablSettings delete maybe? Anything I can really do to figure out why it's not loading them?

You can try deleting GlobalSettings file but I believe it has nothing to do with loading particular save 😕
Are you running game with subscribed TMPE? Where do you put compiled dll's if you are using your own build?

Not subscribed TMPE, built files. Using the locations defined in the project (I even made a shortcut to D:\Games)

You can put all dll's to
C:\Users\<User Folder>\AppData\Local\Colossal Order\Cities_Skylines\Addons\Mods\TrafficManager

As far as I know that's where they go according to the project, no? I saw them there last time I checked

Yup, that folder is set in post build script

I've pushed my commits to 1.10.15 and I think you should sync again 😉

I'm on a different computer this time, but I cannot reproduce the working version. It still fails to load the manual traffic lights (am using latest commit).

Manual traffic lights?

I have absolutely no idea what I changed, but I just loaded up the level and it worked. I'll try again on my desktop before closing this issue (as I'm on my laptop), but that's.... odd.

After clearing my cache, deleting almost everything in my LocalAppData Colossal Data folder, and deleting every mod configuration I had, it still does not load timed traffic lights. I will mention, however, that when I am subscribed to the workshop version of the mod, it does. Could this be an issue with the build process?

one moment 😉

Ok, sync via steam workshop mod and tell me if it's working

Yes, it is working. When you sent that, I was in the middle of loading my savegame. Do you want me to exit and re-sync again?

Yup, I've updated mod on steam with fix

Unfortunately it seems that every savegame created on new build has no TMPE data inside because of null pointer exception... All savegames created before this build should work normally

Ok, well I can confirm that when building with the latest master (your hotfix), it still does not work. And I can also confirm that when playing with the workshop it works. (Sorry it took me so long to do this, loading with 75 mods on 12 GB of ram (reaching 11 GB on the game itself O.o) doesn't work very well lol.

No problem and thank you for confirmation 😉
Let's fix something 😆

When not subscribed through Steam workshop, the PluginInfo object might be missing; if parts of config, logging, or whatever, are expecting that object, they could be causing the problem. There are probably some hard-coded folder paths or something to allow for testing in build environment, and if you've not got those set up correctly that could cause issues.
(For reference, here's some carnage that happened with Real Time mod when not installed through Steam)

I will check that, thanks 😃

How is it working out its folder paths, eg. for the localisation .txt files?

They are compiled in dll file 😉

Well, it seems we've found the cause of this, so that's good. Now we just need to investigate why it's happening.

Did we ever find out what caused this?

I don't think so. If I recall, we discussed about the fact that this resulted from building the game yourself, and was not an issue with the workshop item. However, I don't think we identified a cause.

Is it possible that it was caused by having two versions of TM:PE at the same time, even if one was disabled?
Does it still happen? (if not can this be closed?)

I think we didn't know about that then, so yeah, it is possible

I will test later today and report back here

Unless anyone states otherwise, I'm going to assume this was caused by multiple TM:PE versions present at same time, in which case #333 updates to incompatibility mod checker will resolve the issue (at least for most end users).

I can confirm that this is still an issue related merely to building the DEBUG version of the mod. Using the workshop versions does not make this issue.

I'm closing this. I've just checked attached log again to see well known error: Error deserializing data: System.ArgumentException: Object type System.Collections.Generic.List'1[xyz] cannot be converted to target type: System.Collections.Generic.List'1[xyz]

@krzychu124 What causes that error, for future reference?

Multiple mod subscriptions for sure (probably one local and one from workshop but disabled).


Added placement guidance

We want providers to know that they will be asked about placements later in the academic year, so they should keep a record even though they can't add the data now.

 Make 'Schools' wording on 'Check what data you need' guidance page for SCITTs clearer.


feat: Add save icon

Added save icon from issue #39

Sorry for stepping on your toes, but I added a save icon in a recent release (https://github.com/colebemis/feather/blob/master/icons/core/save.svg). Let me know if you have any more icon requests 👍


Convert (semi) recent tutorial gists into blog posts.

Better late than never? I've found a few people asking for information that these pages provide, so hosting them up on the website seems nice vs just linking to the gists.

Title
Original gist
Website preview

Exploring IREE CPU microkernels on a simple matmul example
gist link
https://scotttodd.github.io/iree/community/blog/2024-01-22-exploring-cpu-microkernels-on-a-matmul-example/

IREE/MLIR/Linalg tutorial
gist link
https://scotttodd.github.io/iree/community/blog/2024-01-29-iree-mlir-linalg-tutorial/

MLIR syntax highlighting will still need some work to enable on the website, but otherwise I think these look good when rendered through mkdocs.
Note that since the previous latest blog posts on https://iree.dev/community/blog/ are from 2021, that page is not very discoverable (we kept it around but more hidden). If we start using it more we could add it to the top level website nav.

Nice 🙂

@ScottTodd thanks again ; I just noticed that on https://iree.dev/community/blog/2024-01-22-exploring-cpu-microkernels-on-a-matmul-example/#overview-of-the-compilation-and-linking-flow the styling in the mermaid flow chat has been dropped, losing the color-coding of the 3 parts. Since this is a source-level change it seems intentional, so I'm curious? Specifically these lines were dropped at the end of the mermaid block:
style Part1 fill:#FFF9C4, stroke:#FDD835
style Part2 fill:#B3E5FC, stroke:#039BE5
style Part3 fill:#C8E6C9, stroke:#43A047

Ah, the colors match the text sections, I see. Checking what our options are...

Side note if you ever do a 2nd pass on this, one thing that broke is the bullet list in the first Note block about iree-compile flags. It used to have nested bullets and now it's expanded to flat.

none of this is worth your time though, sorry about the distraction.


Linkedin OIDC Logo and title in react auth

What kind of change does this PR introduce?
Adding in the linkedin logo and fixing the display name when using the new LinkedIn  OIDC provider
What is the current behavior?
Currently it looks like this with the new provider

Which is not ideal
What is the new behavior?
In the react example it now looks like this running in dev:

The same way it looks with the old provider
Additional context
There is an issue filed for this here:
https://github.com/supabase/auth-ui/issues/234
This is my first pull request here, I've tried to follow the guidelines but apologies if I've not stuck to protocol in some way

Any update on this?


Java example doesn't work

The java SDK cannot get the rooms or room list. Please check.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4b836740-9263-12cc-9001-c61f08448f0d
Version Independent ID: 4a5b79f8-d685-6c86-d7ed-12d7c5d309cb
Content: List places - Microsoft Graph v1.0
Content Source: api-reference/v1.0/api/place-list.md
Product: outlook
Technology: microsoft-graph
GitHub Login: @vrod9429
Microsoft Alias: MSGraphDocsVteam

Hi. Thanks for raising this issue.
The code snippets has been updated based on the new Microsoft Graph Java v6 version.
You can also check more info about the new version in the v6 announcement blog post.


[C++] Add Substrait support for arrow-specific types (non-paramaeterized)

Describe the enhancement requested
The Arrow<->Substrait conversion currently only works with the types that are supported by both Arrow and Substrait.  I would like to use Substrait expression conversion for filter pushdown (polars can convert to a pyarrow.compute expression, and datafusion can consume a substrait expression, and I would like to bridge the two).
This is currently blocked by the fact that polars uses large_string by default and pyarrow.compute expressions fail to serialize if they contain a large_string type.
Since I know that both the source and destination are arrow I should be able to use the arrow-specific types (substrait will consider them user defined types).
To simplify things, this request only asks for support for non-parameterized types.  Arrow-specific parameterized types (e.g. decimal256, large_string, etc.) can come in a future request.
Component(s)
C++

Issue resolved by pull request 40696
https://github.com/apache/arrow/pull/40696


Remove common indentation of triple quotes

Previously, indentation was removed from triple quoted strings based on the first indented line. Now it follows CoffeeScript's policy of removing the indentation shared by all lines. This is a little tricky in the case of tabs.
Once this gets released and we upgrade, it should fix the output of civet --help:
⟫ civet --help                          (quote-indentation ?$)
▄▄· ▪   ▌ ▐·▄▄▄ .▄▄▄▄▄
          ▐█ ▌▪██ ▪█·█▌▀▄.▀·•██       _._     _,-'""`-._
          ██ ▄▄▐█·▐█▐█•▐▀▀▪▄ ▐█.▪    (,-.`._,'(       |\`-/|
          ▐███▌▐█▌ ███ ▐█▄▄▌ ▐█▌·        `-.-' \ )-`( , o o)
          ·▀▀▀ ▀▀▀. ▀   ▀▀▀  ▀▀▀               `-    \`_`"'-

    Usage:

Thanks, looks good!


refactor(module): Make override with different module

So no need to restore original Http service

Current coverage is 100% (diff: 100%)

Merging #110 into master will not change coverage

@@           master   #110   diff @@
====================================
  Files          13     13
  Lines         180    180
  Methods        42     42
  Messages        0      0
  Branches       25     25
====================================
  Hits          180    180
  Misses          0      0
  Partials        0      0

Powered by Codecov. Last update 00c3307...a3ae40f


[nrf fromtree] Bluetooth: Audio: Fix issue with NULL instance for MCC

Updates Zephyr to include MCC fixes

PR into NCS https://github.com/nrfconnect/sdk-nrf/pull/9303


fix: Apply relative path for EventUri and StreamingUri

Hi!
I've found that current solution will not work with FeatBit hosted under non-root host.
Example:
Host set in config https://contoso.com/featbit will not work, and will try to send all requests to https://contoso.com/streaming instead of https://contoso.com/featbit/streaming.
This is a bit naive fix, but it will allow me to use FeatBit with my deployments

Hi @Daenero , thanks for reporting this. I'll take a look later.

According to the documentation here: https://learn.microsoft.com/en-us/dotnet/api/system.uri.-ctor?view=net-6.0#system-uri-ctor(system-uri-system-string)

If the baseUri has relative parts (like /api), then the relative part must be terminated with a slash, (like /api/), if the relative part of baseUri is to be preserved in the constructed Uri.
Additionally, if the relativeUri begins with a slash, then it will replace any relative part of the baseUri

And the following passed test
[Theory]
[InlineData("https://contoso.com/featbit/", "relative", "https://contoso.com/featbit/relative")]
[InlineData("https://contoso.com/featbit/", "relative?type=server", "https://contoso.com/featbit/relative?type=server")]
[InlineData("https://contoso.com", "relative", "https://contoso.com/relative")]
[InlineData("https://contoso.com", "/relative", "https://contoso.com/relative")]
[InlineData("https://contoso.com/", "/relative", "https://contoso.com/relative")]
public void TestCreateUri(string baseUri, string relativeUri, string expected)
{
    var uri = new Uri(new Uri(baseUri), relativeUri);

    Assert.Equal(expected, uri.ToString());
}

I think we can do the following change

In DefaultEventSender.cs file, change the EventPath to "api/public/insight/track". Just remove the leading "/" .
In FbWebSocket.cs file, update DefaultWebSocketUriResolver method to:

private static Uri DefaultWebSocketUriResolver(FbOptions options)
{
    var token = ConnectionToken.New(options.EnvSecret);
    var websocketUri = new Uri(options.StreamingUri, $"streaming?type=server&token={token}");
    return websocketUri;
}

What do you think about this? @Daenero

Since we're planning on releasing a new version today, I've already completed the fixes in #19, so close this one.


[Discussion] Is there any secure way to request data for Chrome extension?

Description
Right now, the extension will request a public data resource to display the diagrams.
Is there any secure way to request private data? Like if we want to add personal recommendations in the future, we may not want the data to be in the public domain.

Hi, @frank-zsy, does it mean that we need a backend server?

No matter what the mechanism is, assume that we have a backend server, how can we control the data if we don't have an account system and need login in frontend?

Maybe we can use jQuery to get loginId:

An existing example:
https://github.com/hypertrons/hypertrons-crx/blob/43e1ed45aaf051a65a7708e3a60bbaf0926c012f/src/pages/ContentScripts/DeveloperNetwork.tsx#L374-L384

Is there any secure way to request private data?

Oh I didn't consider this requirement.

How about authorizing with Github like this?

It is easier for user to login, though we need to design an account system

As there are more implementations of CHAOSS metrics in OpenDigger, I am considering add more data to Hypercrx. If we have no way to handle private data, I will design to use public data first.


LLAMA checkpoint ImportError: undefined symbol

System Info

Architecture: x86_64
OS Ubuntu 22.04
GPU: NVIDIA GeForce RTX 4090
Gpu memory 2x24gb
CPU max MHz: 5000.0000
Driver Version: 535.183.01
CUDA Version: 12.2
Container: nvcr.io/nvidia/tritonserver:24.06-trtllm-python-py3
TensorRT-LLM version: 0.10.0

Who can help?
@byshiue @nv-guomingz
Information

[X] The official example scripts
[ ] My own modified scripts

Tasks

[X] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
[ ] My own task or dataset (give details below)

Reproduction

nvidia-docker run -d -it --name trtllm     -v /home/remotessh/text-generation-webui/models/Llama-2-13b-chat-hf:/root/.cache/huggingface/llama-2-13b-chat-hf     -v /home/remotessh/TensorRT_engines:/engines     --shm-size=16G --network=host nvcr.io/nvidia/tritonserver:24.06-trtllm-python-py3 /bin/bash
11f808569af7484e003da1e5eb26729a7decd74f470b0699d983056df2ca1aef
git clone https://github.com/triton-inference-server/tensorrtllm_backend.git
cd tensorrtllm_backend/
git clone https://github.com/NVIDIA/TensorRT-LLM.git
pip install git+https://github.com/NVIDIA/TensorRT-LLM.git

mkdir /usr/local/lib/python3.10/dist-packages/tensorrt_llm/libs/

cp /opt/tritonserver/backends/tensorrtllm/* /usr/local/lib/python3.10/dist-packages/tensorrt_llm/libs/
export PYTHONPATH=/root/.cache/huggingface/llama-2-13b-chat-hf

This leads to the following error:

ImportError: The bindings module does not exist. Please check the package integrity. If you are attempting to use the pip development mode (editable installation), please execute build_wheels.py first, and then run pip install -e ..

python scripts/build_wheel.py
pip install -e
cd TensorRT-LLM/examples/llama
python convert_checkpoint.py --model_dir /root/.cache/huggingface/llama-2-13b-chat-hf \
                             --output_dir /workspace/tensorrt_llm/llama-2-13b-chat-hf \
                             --dtype float16 \
                             --tp_size 2

To get this error:
/opt/tritonserver/tensorrtllm_backend/TensorRT-LLM/examples/llama# python convert_checkpoint.py --model_dir /root/.cache/huggingface/llama-2-13b-chat-hf/llama-2-13b-chat-hf                              --output_dir /workspace/tensorrt_llm/llama-2-13b-chat-hf                              --dtype float16                              --tp_size 2
Traceback (most recent call last):
File "/opt/tritonserver/tensorrtllm_backend/TensorRT-LLM/examples/llama/convert_checkpoint.py", line 8, in
import tensorrt_llm
File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/init.py", line 32, in
import tensorrt_llm.functional as functional
File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/functional.py", line 28, in
from . import graph_rewriting as gw
File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/graph_rewriting.py", line 12, in
from .network import Network
File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/network.py", line 27, in
from tensorrt_llm.module import Module
File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/module.py", line 17, in
from ._common import default_net
File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/_common.py", line 31, in
from ._utils import str_dtype_to_trt
File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/_utils.py", line 30, in
from tensorrt_llm.bindings.BuildInfo import ENABLE_MULTI_DEVICE

ImportError: /usr/local/lib/python3.10/dist-packages/tensorrt_llm/bindings.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c106detail14torchCheckFailEPKcS2_jRKSs

Expected behavior
convert checkpoints successfull
actual behavior
ImportError: /usr/local/lib/python3.10/dist-packages/tensorrt_llm/bindings.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c106detail14torchCheckFailEPKcS2_jRKSs
additional notes
I'm following the official documentation and some fixes suggested by other devs

Hi @Pareek-Yash , if you are using nvcr.io/nvidia/tritonserver:24.06-trtllm-python-py3, then, please use the correspoding TRT-LLM examples: https://github.com/NVIDIA/TensorRT-LLM/tree/v0.10.0/examples/llama

Hi @Pareek-Yash , if you are using nvcr.io/nvidia/tritonserver:24.06-trtllm-python-py3, then, please use the correspoding TRT-LLM examples: https://github.com/NVIDIA/TensorRT-LLM/tree/v0.10.0/examples/llama

hey Thank you, changing to 0.10.0 solved the issue,
I have run into another issue which I do not understand in
 python3 ../run.py --max_output_len=50                   --tokenizer_dir /root/.cache/huggingface/llama-2-13b-chat-hf/                   --engine_dir=./tmp/llama/13B/trt_engines/fp16/2-gpu/

[TensorRT-LLM][INFO] MPI size: 1, rank: 0
Traceback (most recent call last):
File "/opt/tritonserver/TensorRT-LLM/examples/llama/../run.py", line 571, in
main(args)
File "/opt/tritonserver/TensorRT-LLM/examples/llama/../run.py", line 420, in main
runner = runner_cls.from_dir(**runner_kwargs)
File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/runtime/model_runner_cpp.py", line 999, in from_dir
return ModelRunnerCppExecutor.from_dir(engine_dir, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/runtime/model_runner_cpp.py", line 98, in from_dir
world_config = WorldConfig.mpi(tensor_parallelism=tp_size,
RuntimeError: [TensorRT-LLM][ERROR] Assertion failed: mpiSize == tp * pp (/tmp/tritonbuild/tensorrtllm/tensorrt_llm/cpp/tensorrt_llm/runtime/worldConfig.cpp:99)

Steps taken:
python convert_checkpoint.py --model_dir /root/.cache/huggingface/llama-2-13b-chat-hf/                             --output_dir ./tllm_checkpoint_2gpu_tp2                             --dtype float16                             --tp_size 2
trtllm-build --checkpoint_dir ./tllm_checkpoint_2gpu_tp2             --output_dir ./tmp/llama/13B/trt_engines/fp16/2-gpu/
           --gemm_plugin float16

[07/16/2024-07:30:55] [TRT-LLM] [I] Build TensorRT engine Unnamed Network 0
[07/16/2024-07:30:55] [TRT] [W] Unused Input: position_ids
[07/16/2024-07:30:55] [TRT] [W] Detected layernorm nodes in FP16.
[07/16/2024-07:30:55] [TRT] [W] Running layernorm after self-attention in FP16 may cause overflow. Exporting the model to the latest available ONNX opset (later than opset 17) to use the INormalizationLayer, or forcing layernorm layers to run in FP32 precision can help with preserving accuracy.
[07/16/2024-07:30:55] [TRT] [W] [RemoveDeadLayers] Input Tensor position_ids is unused or used only at compile-time, but is not being removed.
[07/16/2024-07:30:55] [TRT] [I] Global timing cache in use. Profiling results in this builder pass will be stored.
[07/16/2024-07:30:58] [TRT] [I] [GraphReduction] The approximate region cut reduction algorithm is called.
[07/16/2024-07:30:58] [TRT] [I] Detected 15 inputs and 3 output network tensors.
[07/16/2024-07:31:07] [TRT] [I] Total Host Persistent Memory: 151552
[07/16/2024-07:31:07] [TRT] [I] Total Device Persistent Memory: 0
[07/16/2024-07:31:07] [TRT] [I] Total Scratch Memory: 33559168
[07/16/2024-07:31:07] [TRT] [I] [BlockAssignment] Started assigning block shifts. This will take 778 steps to complete.
[07/16/2024-07:31:07] [TRT] [I] [BlockAssignment] Algorithm ShiftNTopDown took 33.3864ms to assign 17 blocks to 778 nodes requiring 93334528 bytes.
[07/16/2024-07:31:07] [TRT] [I] Total Activation Memory: 93333504
[07/16/2024-07:31:07] [TRT] [I] Total Weights Memory:<PHONE_NUMBER>2
[07/16/2024-07:31:07] [TRT] [I] Engine generation completed in 12.6013 seconds.
[07/16/2024-07:31:07] [TRT] [I] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 625 MiB, GPU 12572 MiB
[07/16/2024-07:31:11] [TRT] [I] [MemUsageStats] Peak memory usage during Engine building and serialization: CPU: 28155 MiB
[07/16/2024-07:31:12] [TRT-LLM] [I] Total time of building Unnamed Network 0: 00:00:16
[07/16/2024-07:31:12] [TRT-LLM] [I] Serializing engine to ./tmp/llama/13B/trt_engines/fp16/2-gpu/rank1.engine...
[07/16/2024-07:31:17] [TRT-LLM] [I] Engine serialized. Total time: 00:00:05
[07/16/2024-07:31:17] [TRT-LLM] [I] Total time of building all engines: 00:00:48

In the convert_checkpoint.py, you pass tp_size=2, so you need to use
mpirun -n 4 --allow-run-as-root \
python ../run.py xxx

this has changed the MPI size, but error remains the same:

[TensorRT-LLM][INFO] MPI size: 4, rank: 3

Update!!
The above error wasn't solved with --shm-size too
docker run -it --name trtllm --gpus all --shm-size=24g -v /home/remotessh/text-generation-webui/models/Llama-2-13b-chat-hf:/root/.cache/huggingface trtllm_final /bin/bash

mpirun -n 2 --allow-run-as-root python3 ../run.py --max_output_len=50                   --tokenizer_dir /root/.cache/huggingface/llama-2-13b-chat-hf/                   --engine_dir=/opt/tritonserver/TensorRT-LLM/examples/llama/tmp/llama/13B/trt_engines/fp16/2-gpu  --input_text "How do I count to nine in French?"

The same error as above.


Show other syntax output

First thank you for you work! I couldn't find any other that worked.
Your works nicely but I'm having some problems formatting the output. Your code gives out only the temperature, but I need this:
{
    "temperature": 25.8
}

the important thing is to point out that I need double quotes, often it changes them to single ones afterwards. Could you help me?

Hi - glad you found this useful.
You should be able to replace the line of code here https://github.com/robintw/FlaskTemperature/blob/master/app.py#L10 with the following to get the output you want:
temp = get_temperature()
result = '{\n\t"temperature": %s\n}'
return result % (temp)

I haven't tested that, but it should include the double-quotes (I wrapped the string in single quotes, so that double quotes still worked inside the string)

Worked perfectly! Thanks!


[Documentation] Move all wiki pages into the repo and make it pretty

Greetings,
This should fix #2356
I used the time while watching a stupid movie to move all wiki files to .md files and setup github pages automation and documentation generation using daux.io.
I have done a bit of "quality checking" but it's mostly a copy of the current wiki content.
You will need to setup a github pages site and then adapt the workflow (maybe integrate the step with another workflow that is already running anyways and will look for folder updates)
You can already see this working here: https://bockiii.github.io/rss-bridge/index.html (ignore the unavailable image, small bugfixes that I will do in the coming days)
Todo (and looking for volunteers):

Come up with a nicer (aka darker) color scheme for the page. It's easily customizable ( https://daux.io/For_Developers/Creating_a_Theme.html ) but I'm not the visual guy. I just know that the light theme burns my eyes.
Check references to "wiki" and pages that might be located somewhere else now. I already fixed all links, but haven't read through it all.
Review the actual content. Some of the info is years old (aka 4 years and older since the last touch in the wiki) so it might be out of date.

I invite you all for comments and help with the todos

This is great! I think we should ignore the third bullet point for now as it could significantly sidetrack the PR.

I agree @yamanq , the review can take place after this PR. I just wrote it down for notekeeping (it was 3am when I opened the PR :D )
I just tried to do a theme and it can work, but CSS is just not my thing. I was able to get the general view (like sidebar and main site) to kinda look like the Github Dark theme, but then you also have to "darkify" all the tables, code snippets and so on. So maybe someone craftier with that stuff can do it. I'm gonna add the base for a theme to the PR but not switch to it yet, so people can just do the css instead of also having to prepare other things in daux. A simple config line switch should do it then.

I also retract my initial statement: It has to be it's own workflow since the path trigger that I just introduced only works on workflow level. So in order for the documentation build only to happen when actual documentation is changed, it needs it's own workflow.
So no workflow-integration needed here.

So @em92 : Things to do for this to work (in order):

Merge the PR. This will do one workflow run of the "documentation" flow that will generate the "gh-pages" branch in the rss-bridge repo.
Go to the repo settings, activate pages and set them like this:

(branch "gh-pages", folder /root)
A workflow named "pages-build-deployment" should start to run (its a github default one and wont show in the workflows directory) and publish the site at rss-bridge.github.io

Theming and review can take place in a second PR but both would need the PR to be merged anyways (so that changes can be done to them).

@em92 anything missing?

I think this is great. Having the docs side by side with the code in git is the way to go in my opinion.


WIP: Support for lcov/gcov with Ninja

This is an attempt to better integrate the Ninja build system (issue #29, but also #6).
It is just meant for discussion, for there are still a few things to sort out, e.g. the target versions of CMake, Ninja, gcc, ... It's a bit of a mess.
Whatever the response, it would be nice to have a github action that runs tests for at least some combinations of the above.

Codecov Report

Merging #30 (115a51d) into master (06a61fc) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##            master       #30   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            5         4    -1
  Lines           20        17    -3
=========================================
- Hits            20        17    -3

Impacted Files
Coverage Δ

src/fortran/hello.f

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 06a61fc...115a51d. Read the comment docs.


Remove single BRAW clip from ingest list

There doesn't seem to be a way to remove a single cli (or selected clips) from the list before ingesting/processing. You can clear all the files, but if you add a file by accident in a list of others, you can't remove it and you have to clear the list and select the correct ones. It would be great if the delete key would remove any selected clips from the list, or if there was a button below to "Clear Selected Clips" that became available when you selected clips in the list.

I have quite a few interviews shot in BRAW with 2 cameras, and the Finder was taking a bit to show the preview, so I decided to select all 8 clips and use BRAW Toolbox to navigate them and remove the 1 interview I had already imported. I realized that didn't work.

Agreed - will try add in the next public beta.

This will be included in next beta.


Change location for configuration files

level: low
The current location "C.\Export\SignaturenDruck" for the configuration files is not very obvious and difficult to find for admins who don't know the programme. I suggest changing it to "C:\SignaturenDruck".

In the current release this issues is already solved. C:\Export is only used for saving the download file


bougies, calcspars

This pull request was generated by the 'mq' tool
[test]
flake rate: 0.4
logical conflict every: 100
sleep for: 300s
[pullrequest]
requests per hour: 30
deps=[b,c]

/trunk merge


BlockUntilKeyUp functionality

I'd like to implement a "SpaceFN" layer (ie. while space is held down, activate another layer).
Here's a small example showing how to map Space+J to "left":
{
    "description": "Space + J = LEFT",
    "from": {
        "key_code": "j",
        "modifiers": {
            "mandatory": [
                "fn"
            ]
        }
    },
    "to": [
        {
            "key_code": "left_arrow"
        }
    ],
    "type": "basic"
},
{
    "description": "Space as fn",
    "from": {
        "key_code": "spacebar"
    },
    "to": [
        {
            "key_code": "fn"
        }
    ],
    "to_if_alone": [
        {
            "key_code": "spacebar"
        }
    ],
    "type": "basic"
},

The problem is, space is pressed very often during normal typing, so it is all too easy for this kind of set-up to produce unwanted "fn" presses instead of spacebar presses when typing fast.
With the old Karabiner, __BlockUntilKeyUp__ took care of this quite nicely, or at least, I think it did if I understand its purpose. It basically meant, I think, that it wouldn't fire one of the layer events unless Space were pressed before another key, and released after the other key:
# This triggers a layer event (ie. LEFT)
Space down ---> J down ---> J up ---> Space up

# This normal roll-over does not trigger a layer event, just SPACE then J:
Space down ---> J down ---> Space up ---> J up

Here's the full version of the old Karabiner config: https://github.com/wincent/wincent/blob/c250a81d235bef574d3a7cf2f2bb7a585bcd9686/roles/keyboard/files/spacefn.xml

I would go like this:

{
            "description": "Second Layer",
            "manipulators": [
                {
                    "from": {
                        "key_code": "spacebar"
                    },
                    "to": [
                        {
                            "set_variable": {
                                "name": "another_layer",
                                "value": 1
                            }
                        }
                    ],
                    "to_if_alone": [
                        {
                            "key_code": "spacebar"
                        }
                    ],
                    "to_after_key_up": [
                        {
                            "set_variable": {
                                "name": "another_layer",
                                "value": 0
                            }
                        }
                    ],
                    "type": "basic"
                },
                {
                    "conditions": [
                        {
                            "type": "variable_if",
                            "name": "another_layer",
                            "value": 1
                        }
                    ],
                    "from": {
                        "key_code": "j",
                        "modifiers": {
                            "mandatory": [
                                "fn"
                            ]
                        }
                    },
                    "to": [
                        {
                            "key_code": "left_arrow"
                        }
                    ],
                    "type": "basic"
                },
                {
                    "conditions": ...

@michelkoga: That's much better. Thanks.
However, I still think I need an equivalent for __BlockUntilKeyUp__. Without this, configurations like the above don't handle rollover well. I am going to keep playing around and see if I can come up with something in terms of variables and to_if_alone_timeout_milliseconds perhaps, but ultimately I think I need something else.

The new to_if_held_down property allows us to get pretty close to what we would need here, but it is not quite there; given this config:
                        "description": "SpaceFN layer",
                        "manipulators": [
                            {
                                "from": {
                                    "key_code": "spacebar",
                                    "modifiers": {
                                        "optional": [
                                            "any"
                                        ]
                                    }
                                },
                                "to_if_held_down": [
                                    {
                                        "set_variable": {
                                            "name": "SpaceFN",
                                            "value": 1
                                        }
                                    }
                                ],
                                "to_after_key_up": [
                                    {
                                        "set_variable": {
                                            "name": "SpaceFN",
                                            "value": 0
                                        }
                                    }
                                ],
                                "to": [
                                  {
                                    "key_code": "spacebar",
                                    "repeat":  false
                                  }
                                ],
                                "type": "basic"
                            },

We can prevent the SpaceFN layer from kicking in until the key is pressed for a while, and we can still enjoy normal rollover while typing fast. The only gotcha is that initial press of the space bar causes an immediate key-down/key-up to be sent, even if you end up just pressing and holding (ie. your intention is to enter SpaceFN mode). This is very close to being usable now, but I think we still need something like __BlockUntilKeyUp__.

Would the new "simultaneous" feature help with this?
https://pqrs.org/osx/karabiner/json.html#simultaneous

I don't think so.

Yes, simultaneous is not the replacement of __BlockUntilKeyUp__ yet.

Seems like it is now though. 😄
For example:
https://github.com/wincent/wincent/commit/8fe03134e1c5201264ed2f1e5373c8720e2019f8

I updated karabiner.json Reference Manual about simultaneous_options.
https://pqrs.org/osx/karabiner/json.html#simultaneous-options

Thanks, @tekezo, the docs contained the crucial information that I was missing: "simultaneous_options is available only in the beta versions." Once I upgraded from the released 11.6.0 to the beta 11.6.6, I was able to get @wincent's config (https://github.com/wincent/wincent/commit/8fe03134e1c5201264ed2f1e5373c8720e2019f8) to work.
Once issue that I haven't been able to resolve is how to disable autorepeat for spacebar. (SpaceFn relies on this because it uses space as a modifier when held. Spacebar+b, which emits a space, should continue to autorepeat.) A manipulator like the following is effective at preventing autorepeat, but also stops @wincent's SpaceFn manipulators from working:
                            {
                                "from": {
                                    "key_code": "spacebar",
                                    "modifiers": {
                                        "optional": [
                                            "any"
                                        ]
                                    }
                                },
                                "to": [
                                    {
                                        "key_code": "spacebar",
                                        "repeat": false
                                    }
                                ],
                                "type": "basic"
                            }

Do you (or anyone) have a solution for that? Thanks!

@ljosa are you still having this problem with the latest version? It's working as desired for me

The SpaceFN configuration listed here should be updated with the fix by @wincent.

I'd second sven's request.  It would have saved me a fair few hours of banging my head against the wall!

Should this issue be reopened? Seems like it is only resolved for @wincent, but everyone else is still waiting for a fix before spacefn is usable :)

@yzhuang: SpaceFN works well for me with this config: https://gist.github.com/ljosa/df7a08953a050f8b49997840095d132d

It's definitely usable. You just need to configure it correctly. I am on phone now so I and post full example config but this is the script I use to generate it.

Yup.  I was speaking for the people waiting for the complex modification repository to be updated, and advocating for a longer term fix.
For myself, I took the same route ljosa did --- I took the fix in https://github.com/wincent/wincent/commit/8fe03134e1c5201264ed2f1e5373c8720e2019f8 and modified it by hand to suite my needs.  It was quite tedious, and now I am on a forked version of the spacefn config.
Will give the javascript generation script a try tonight.  Thanks for helping!

This SpaceFn thing is the only reason I'm trying out Karabiner Elements and the version I've downloaded from https://pqrs.org/osx/karabiner/complex_modifications/ has no effect; my spacebar works the same way as before.
I've also tried the Change caps_lock to control if pressed with other keys, to escape if pressed alone. mod. That didn't work either first, even after an upgrade to the latest (12.7.0) version.
After a reinstall, at least the capslock->ctrl/esc works, but spacefn still does not :(
I will look at the links in the last 3 comments; but I wanted to indicate that there is 1 more person how cares about this :)
(I bought a Minidox and soldered together my own Troy Fletcher's Signum 3.0, but I'm curious if I can implement at least these 2 basic layout enhancement ideas without custom keyboard firmwares for my colleagues at the company I'm working for currently)

After checking out @ljosa 's karabiner.json, I've just realised it starts with a SpaceFn layer rule, which is required for the rest of the config to work.
The published SpaceFN configuration also has a similar rule, called SpaceFN: Space enables SpaceFN mode (see: https://geekhack.org/index.php?topic=51069.0), which I've have not enabled, because I have not understood its relevance, but it actually works.
I have to say though, it's rather annoying that space only gets registered on release and I did not expect this side effect. I understand there is no way around it, but it's still sad... :)
Thanks everyone for their useful comments; great script @wincent !

After trying to use both solutions (the official one and ljosa's) I finally understood the problems you were discussing here.
The official version misbehaves during quick typing because it interprets a space-down/k-down/space-up/k-up sequence as down arrow, but at least it doesn't repeat space when held long without pressing any other key.
The ljosa version takes into account the release sequence of keys, but repeats space.
Can I turn off the space repeat somehow with a recent Karabiner-Elements version (12.7.0) without having rollover issues?

I already linked a working config above that suffers from none of the problems you described.


About the img_downscale

Hi, I have pull down your newest code.
However,  I cannot run the finetune script for you have not define the img_scale in train_mvs_nerf_finetuning_pl.py

And I add the code args.img_downscale = 1.0 at line:205, right?

Oh, sorry, please try again.


MPV not detected

I'm using the debug mode and whenever I try to open MPV, the debug mode can't seem to find it.

Hi there @riegojerey, thanks for writing! I apologize for the delay in responding.
I realize there is a PR by @ajs124 that probably fixes this issue for you, but I was wondering if you'd also be able to provide logs or a short recording to help me document this for my internal backlog. I would like this give this more attention in a future release.
Please feel free to respond with more details if you're able to get them, otherwise I'll treat this as something that has a workaround available (in the form of @ajs124's fork) and close. Thank you!


Tests hang from dotnet test

Steps to reproduce
Tests run on travis CI via dotnet test now intermittently fail. Failures started after updating to a newer .NET Core SDK. It appears that the test tool increased from 16.0.1 to 16.1.1 with the new SDK.
Source code: https://github.com/grpc/grpc-dotnet/commits/master
Expected behavior
Tests run and exit
Actual behavior
Tests hang and the build is terminated
Diagnostic logs
Failure: https://travis-ci.org/grpc/grpc-dotnet/builds/551562232?utm_source=github_status&utm_medium=notification
Microsoft (R) Test Execution Command Line Tool Version 16.1.1
Success: https://travis-ci.org/grpc/grpc-dotnet/builds/551058627?utm_source=github_status&utm_medium=notification
Microsoft (R) Test Execution Command Line Tool Version 16.0.1

@JamesNK , if this is an intermediate issue, can you please enable diagnostics logs for testplatform & share those with us https://github.com/Microsoft/vstest-docs/blob/master/docs/diagnose.md

I can't easily get logs off the build server but I can repo freezing on my dev machine with this. It freezes all the time within a couple of iterations:
while($true) { dotnet test --diag:log.txt }
testlogs.zip

This is an ongoing problem. I'd like to make some progress on fixing it.
Do you need anymore information from me?

@JamesNK I went through the logs & from the logs I didn't see any hang state. The only interesting thing I observed was that it seemed we start 10 different testhost processes in sequence, but you have shared logs for 30 testhost process. Can you please share how many test dlls are you running ?

Because I'm doing it in a loop: while($true) { dotnet test --diag:log.txt }
In the example of the logs I attached it freezes are 3 runs.
Have you tried reproing it?

I'm looking into it, I've cloned the repo, & all I need to do is run dotnet on sln right?

I tried it locally multiple times, but it did not repro for me.

We are currently experiencing the same issue. We have been using mcr.microsoft.com/dotnet/core/sdk:2.2.204 to avoid the performance degradation issue which is now resolved. But when attempting the latest mcr.microsoft.com/dotnet/core/sdk, currently b4c25c26dc73f498073fcdb4aefe167793eb3a8c79effa76df768006b5c345b8, only a couple test runs finish while the rest seem to hang.
As with the performance issue, it seems to be related to non-interactive hosts.
Situation

Our solution contains 10 test projects, each one has <IsTestProject>true</IsTestProject> set, and we are running dotnet test against the solution in a CircleCI environment.
When each test is run individually, everything works as intended.
When run locally, i see only 4 tests run at any time. And the local system only has 4 cpu cores.

Replication
I condensed our project to share an example. Each test project has a single test that sleeps for 5sec.
Repo: https://github.com/tasadar2/vstest-issue-2080
CircleCI: https://circleci.com/gh/tasadar2/vstest-issue-2080/3
It doesn't always replicate the issue, but often does.

Running test projects individually has fixed this problem for us - https://github.com/grpc/grpc-dotnet/commit/152255ec5419c1360819788d7911f4957c8e4e2c

@tasadar2 @JamesNK sdk:2.2.301 has a fix, can you please check if you are still hitting the issue ?

Still appears to be an issue.
image: mcr.microsoft.com/dotnet/core/sdk@sha256:a50e175acd618c3e90bc91dceb5194e6c3764c5b4d179390cef874a887476ba9
example: https://circleci.com/gh/tasadar2/vstest-issue-2080/7

I've narrowed down my hanging issue to with how vstest writes to the console. If no tests fail then vstest completes without any problems. If a test fails then it hangs until the CI build times out (this is in Travis CI)
The workaround I am using is to write the test output to a text file, and the write the text file to console.

@JamesNK What is the dotnet sdk version you are using ? Can you share the link to the CI ?

3.0.100-preview8-013532
https://travis-ci.org/grpc/grpc-dotnet/builds/565363470?utm_source=github_status&utm_medium=notification

Here is a repro for this issue on CircleCI
https://github.com/davidruhmann/vstest2080
https://circleci.com/gh/davidruhmann/vstest2080/3
Each line of Test run in progress. output takes several seconds making the tests take a long time on big projects.

Looks like this is still an issue on the recent 3.0.
image: mcr.microsoft.com/dotnet/core/sdk@sha256:3afea8958440231a77b3daea267951cc8ba9026fc1015bcbccc206d6f1d031f7
example: https://app.circleci.com/jobs/github/tasadar2/vstest-issue-2080/10

@tasadar2 Can you please try to use --logger:console;noprogress=true argument and check the issue reproduces for you ?

That arg produces the same results, https://app.circleci.com/jobs/github/tasadar2/vstest-issue-2080/11

Though, when quoting the argument value, that seems to work --logger:"console;noprogress=true"
https://app.circleci.com/jobs/github/tasadar2/vstest-issue-2080/14

I had the same problem, two workaround worked:
Adding --logger:"console;noprogress=true" like @tasadar2
However, I did not like it because I could not see the progress, so instead added < /dev/null
dotnet test .... < /dev/null

This allow me to see the progress of tests, without hanging.

Full logs of a successful build with feedback https://circleci.com/gh/dgarage/NBXplorer/430 before the hack you can see things stalling https://circleci.com/gh/dgarage/NBXplorer/409

@NicolasDorier thank you for finding your workaround. I can confirm it works, please see rabbitmq/rabbitmq-dotnet-client#750

Is there a longer term fix for this? I'm running into the same issue with a set of web integration tests.

Ping @mayankbansal018  please remove the tag, there is enough information and this issue and workaround have been tested by numerous people. This is a bug that need to be fixed and well identified.

@JamesNK So far it looks like it is caused by setting color at the same time as setting cursor position. https://github.com/microsoft/vstest/issues/2282 Exploring strategies how to avoid that. Probably the best is to write the progress in a way similar to @NicolasDorier comment above.  But ideally write dots at the end of the line, so the output is not affected that much.
Experimenting with it here, and also trying to get it to lock up by moving cursor on the vstest-like branch. See the other thread for some more info.
https://travis-ci.org/github/nohwnd/ProgressToy/branches

Only to confirm that we get that problem in Concourse if and only if dotnet test executed on a solution file.

@NicolasDorier Any suggestions for windows powershell?

I don't remember having the issue on powershell.

I had this problem with a small vm (2 cores, 2GB ram), increasing to 8cores and 8gb ram make it work. I read at some place that this was thread related so I came up with the more cores idea

Not sure if it's related. I'm also a GitLab user and found a very similar problem so I suspect it's probably related to the SDK image, but in my case happens with Microsoft (R) Test Execution Command Line Tool Version 16.9.1
https://forum.gitlab.com/t/dotnet-test-hangs-in-gitlab-gitlab-runner-13-9-0-rc2/50977

Out of curiosity, is anybody experiencing this only when using IHostedService? In my case it seems that's what causing the tests to freeze within a linux image

--logger:"console;noprogress=true"
This helped us in case of IHostedService:
https://www.strathweb.com/2021/05/the-curious-case-of-asp-net-core-integration-test-deadlock/

@Evangelink @davidfowl Even on our very powerful Macbook pros, when we are running one of our integration test projects that has hundreds of tests, many of which use WebApplicationFactory we often get into deadlocks.
We set xunit to use unlimited amount of threads (-1), we have overridden a bunch of xunit stuff to implement a semaphore to limit the number of concurrent tests.
And yet, often we get into deadlocks after the ~600 tests completed mark.
After verifying we have no sync-over-async, we found this beauty in asp.net core code itself...

https://github.com/dotnet/aspnetcore/blob/main/src/Hosting/TestHost/src/TestServer.cs#L101
Can this be the root cause for all our deadlocks only in Unit tests problems?

Finally! I managed to reproduce it in a small test project, where I can do dotnet-dump and attach to process without everything crashing.
I found this fella in one of the threads' callstack.

And going up the callstack we can see it's inside (or trying to get inside and the debugger is misleading) a lock block of NLog.

Can you file this issue on dotnet/aspnet

Your request is my command: https://github.com/dotnet/aspnetcore/issues/43353

just in case this helps someone, at a random time this line started randomly hanging our tests
_task = Task.Factory.StartNew(async () =>
{
await Task.Delay((int)cleanInterval.TotalMilliseconds, _cancellationTokenSource.Token);
-->     while (!_cancellationTokenSource.Token.IsCancellationRequested)

@cvpoienaru Please investigate this issue.

Did anything happen in the investigation by chance?

I am experiencing the same when using TestServer.
It works well locally, when running in GitLab runner, it hangs.
I've noticed it gets frozen when trying to dispose TestServer because the disposing of IWebHost hangs.
No exceptions thrown.
I've tried to stop all the IHostedService in case that's the problem, but still unable to dispose TestServer to see if that solves the problem.
Could I know how are you troubleshooting this? The only workaround i have is to set
#if DEBUG
[assembly: CollectionBehavior(CollectionBehavior.CollectionPerClass, DisableTestParallelization = false)]
#else
[assembly: CollectionBehavior(CollectionBehavior.CollectionPerClass, DisableTestParallelization = true)]
#endif

in the test assembly, so that it runs sequentially in CI/CD pipeline.

@cvpoienaru Please investigate this issue.

This is still an issue

This issue is still unresolved.

This issue is a mix of different problems, some related to other products, but I did not find a clear repro. If someone is still experiencing this problem and has a simple repro, please file a new issue.


Identify SSL certs that require a different validation process

Background

There are some instances where we mange some ssl certificate renewals but don't manage the DNS for validation. These cases can add additional time to that process which can increase the risk of certs not being renewed in time.
Is there a way we can reduce this risk. We may not be able to change the process outside of our control but at least we can be more aware of them.
Approach

Identify which certs this relates to.
Document which certs and who the validation contact are.
Link list to the runbook.

Acceptance Criteria

[ ] List of certs that have a different validation process that can be shared who the team
[ ] Runbook updated

Reference
How to write good user stories

Excel sheet started https://docs.google.com/spreadsheets/d/1gAVhX8Ts-BuhZRNBEF-80UUjlnYyyMKKBQ4ZPnHPZmE/edit#gid=0
Working through the certificates group email to see which emails in the past we have sent a CNAME to another team or person


Huawei and Samsung support

Hi, first of all, you got a great library, very lightweight and easy to use!
Since the readme mentions Huawei devices not being tested, I took the liberty of doing so on two devices I have available.

P9 lite mini (SLA-L22) running Android 7.0 and EMUI 5.1.3. This one works perfectly with the intent present in the library.

Y6 2019 (MRD-LX1) running Android 9 and EMUI 9.1.0. This one doesn't work at all - simple ActivityNotFoundException since the System Manager has apparently changed. So I did some reverse engineering to see what's what.

Turns out there's a screen that might be of interest to you and can be opened with an intent (found a whole bunch of interesting activities, but they usually require a Huawei's custom permission).
It's the "App launch" screen that can be found in the device settings under the "Battery" screen. To open it, you can use
ComponentName("com.huawei.systemmanager",
    "com.huawei.systemmanager.startupmgr.ui.StartupNormalAppListActivity")

Now I don't know which versions of EMUI have what, but I'd wager, based on what backgroundable says, that anything newer than EMUI 5 (which probably includes Android Oreo and up) isn't gonna support com.huawei.systemmanager.optimize.process.ProtectActivity.
Getting back to backgroundable and Samsung, I recommend checking out what they suggest, which is using
ComponentName("com.samsung.android.lool",
    "com.samsung.android.sm.ui.battery.BatteryActivity")

Two things to consider here though: this only works on Android 7.0 and up and it's not really about autostart - it's a "power monitor" setting, which I suppose lets you decide whether you want Samsung's power management (not to mistake with Android OS default power management) to screw your app up or not. This may or may not include autostart features.
Personally, I do recommend including Samsung in supported manufacturers, since their phones really do suck when it comes to running apps that have scheduled and/or background tasks.

@NoHarmDan dude!! thank you :100:
Thanks for testing those out, I'll definitely update the readme and add those to the library. At this point its pretty much a combination of various activity names and brute force to get it working since the package names keep changing but thanks again for taking the time to do this.
I'm a little busy but I'll get to this over the weekend and have these changes merged into the main branch.


Start ./bin/go-mysql-elasticsearch -config=./etc/river.toml

Hello everybody
I am not at all a programmer but im trying to work with elasticsearch and mysql. The problem is after i have done the configurations, i cannot figure out how to run this command  Start ./bin/go-mysql-elasticsearch -config=./etc/river.toml
I tried to run in it in cmd but it doesn't recognise it :/
How to start it so i can see if the sync is happening ?
And is it enough to only follow the steps here so i can have real time migration of data from mysql to es ?
thank you

can you show the full output in the console?

@siddontang  Sure

Hi @esmeraldahs
Can you ensure the go-mysql-elasticsearch is in your bin directory? If you use Windows, I think the name may be go-mysql-elasticsearch.exe.


Please upload 12.6 release to PyPi (Django3 support)

Latest uploaded version still 12.5

https://github.com/jazzband-roadies/help/issues/182


Include Cilium in list of "Cluster Networking" options in Kubernetes docs

https://kubernetes.io/docs/concepts/cluster-administration/networking/

PR pending: https://github.com/kubernetes/kubernetes.github.io/pull/3936

PR merged


FR: Expose passwordUpdatedAt in auth.UserRecord

Operating System version: Linux
Firebase SDK version: v4.15.1
Library version: v4.15.1
Firebase Product: auth

Describe the problem
I need to enforce passwords rotation and for that I need the timestamp when the password was last changed. This is available via the REST API as the passwordUpdatedAt property, which is my current workaround. It would be nice to have this included in the Go SDK though, so I don't have to mix raw HTTP calls with SDK.
Steps to reproduce:
auth.UserRecord struct does not have the PasswordUpdatedAt property. Looks like the REST parsing inside the SDK is done via the userQueryResponse struct in user_mgt.go file. That one is missing this property too.
Can you make this property available please? Thanks!

Even better would be to expose everything, that the REST API returns. Otherwise the admin API is kind of limited. Thank!


mxnet to tensorflow problem: IR->TF failed, looks like the pooling caused?

Platform (like ubuntu 16.04/win10): ubuntu 16.04
Python version: 2.7
Source framework with version: mxnet (newest one)
Destination framework with version : TF
Mx->IR： success
IR->TF :  Failed
I check the codes step by step and found the pooling caused the problem:
mx.sym.pooling()
But if I replace above with
mx.sym.pooling(global=True)
the MX model can be converted to TF successfully.
In the link below, there are several files:
the original MXNET files: model-0001.paras, model-symbol.json
all the other files are generated file from MX->IR step
and it failed during IR->TF step.
Link: link
Any one knows who to solve this problem? Following are error message from IR->TF step:
Parse file [IR_output.pb] with binary format successfully.
('...IR_node....', <mmdnn.conversion.common.IR.IR_graph.IRGraphNode object at 0x7f669423c610>)
Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/_script/IRToCode.py", line 122, in <module>
    _main()
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/_script/IRToCode.py", line 117, in _main
    ret = _convert(args)
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/_script/IRToCode.py", line 61, in _convert
    emitter.run(args.dstModelPath, args.dstWeightPath, args.phase)
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/common/DataStructure/emitter.py", line 21, in run
    self.save_code(dstNetworkPath, phase)
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/common/DataStructure/emitter.py", line 53, in save_code
    code = self.gen_code(phase)
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/tensorflow/tensorflow_emitter.py", line 81, in gen_code
    func(current_node)
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/tensorflow/tensorflow_emitter.py", line 193, in emit_Pool
    padding = IR_node.get_attr('pads')[1:dim]
TypeError: 'NoneType' object has no attribute '__getitem__'

Hi @xmuszq
Thanks for your issue! We have fixed the bug ,try the newest code please!

I tried the newest verson, looks like new issue occur:
warnings.warn(msg)
Warning: MXNet Parser has not supported operator null with name data.
Warning: convert the null operator with name [data] into input layer.
infer_shape error. Arguments:
data: (1, 3)
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File
"/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/_script/convertToIR.py",
line 197, in
_main()
File
"/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/_script/convertToIR.py",
line 192, in _main
ret = _convert(args)
File
"/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/_script/convertToIR.py",
line 115, in _convert
parser.run(args.dstPath)
File
"/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/common/DataStructure/parser.py",
line 22, in run
self.gen_IR()
File
"/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/mxnet/mxnet_parser.py",
line 262, in gen_IR
func(current_node)
File
"/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/mxnet/mxnet_parser.py",
line 424, in rename_Convolution
self.set_output_shape(source_node, IR_node)
File
"/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/mxnet/mxnet_parser.py",
line 281, in set_output_shape
arg_shape, output_shape, aux_shape = sym.infer_shape(data =
self.data_shape)
File "/usr/local/lib/python2.7/dist-packages/mxnet/symbol/symbol.py",
line 990, in infer_shape
res = self._infer_shape_impl(False, *args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/mxnet/symbol/symbol.py",
line 1120, in _infer_shape_impl
ctypes.byref(complete)))
File "/usr/local/lib/python2.7/dist-packages/mxnet/base.py", line 149, in
check_call
raise MXNetError(py_str(_LIB.MXGetLastError()))
mxnet.base.MXNetError: Error in operator convolution0: [09:04:42]
src/operator/nn/convolution.cc:143: Check failed: dshp.ndim() == 4U (2 vs.
4) Input data should be 4D in batch-num_filter-y-x
On Thu, Jul 5, 2018 at 1:18 AM, namizzz<EMAIL_ADDRESS>wrote:

Closed #285 https://github.com/Microsoft/MMdnn/issues/285.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/Microsoft/MMdnn/issues/285#event-1717219578, or mute
the thread
https://github.com/notifications/unsubscribe-auth/APMWvUNtwNJboZF2Wv-qFOkc4IFmwi06ks5uDaGZgaJpZM4VB3Y_
.

I tried the newest verson, looks like new issue occur:
(Using previous code, I can convert residue model from mxnet to TF, but right now, this also failed with the same error)
  warnings.warn(msg)
Warning: MXNet Parser has not supported operator null with name data.
Warning: convert the null operator with name [data] into input layer.
infer_shape error. Arguments:
  data: (1, 3)
Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/_script/convertToIR.py", line 197, in <module>
    _main()
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/_script/convertToIR.py", line 192, in _main
    ret = _convert(args)
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/_script/convertToIR.py", line 115, in _convert
    parser.run(args.dstPath)
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/common/DataStructure/parser.py", line 22, in run
    self.gen_IR()
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/mxnet/mxnet_parser.py", line 262, in gen_IR
    func(current_node)
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/mxnet/mxnet_parser.py", line 424, in rename_Convolution
    self.set_output_shape(source_node, IR_node)
  File "/usr/local/lib/python2.7/dist-packages/mmdnn/conversion/mxnet/mxnet_parser.py", line 281, in set_output_shape
    arg_shape, output_shape, aux_shape = sym.infer_shape(data = self.data_shape)
  File "/usr/local/lib/python2.7/dist-packages/mxnet/symbol/symbol.py", line 990, in infer_shape
    res = self._infer_shape_impl(False, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/mxnet/symbol/symbol.py", line 1120, in _infer_shape_impl
    ctypes.byref(complete)))
  File "/usr/local/lib/python2.7/dist-packages/mxnet/base.py", line 149, in check_call
    raise MXNetError(py_str(_LIB.MXGetLastError()))
**mxnet.base.MXNetError: Error in operator convolution0: [09:04:42] src/operator/nn/convolution.cc:143: Check failed: dshp.ndim() == 4U (2 vs. 4) Input data should be 4D in batch-num_filter-y-x**

@namizzz
Can you again help me and take a look?
Thank you!

@kitstar
Hi Kitstar,   Can you help me take a look at this issue?
Thank you so much!

Hi @xmuszq , you need to use
--inputShape 3,112,112
not
--inputShape 3 112 112

@namizzz
Thank you so much! It works for this model.


switch from log4j to log4j2

log4j gives a potential security alert in dependency alerts. while this is nothing security critical, best to upgrade to some recent log framework, like log4j2. switching over to different log location when debugging should not be done any more, as we have no sing anybody uses this feature. what you think @saladzic @PaaaulZ  ?

I see it exactly the same. Unfortunately, I don't have enough experience to be more specific since I'm just a student xd


Phoenix Android 2.1.1: Zero balance even though wallet has funds

I have entered the seed into a sparrow desktop wallet and proceeded to send some funds to the wallet. The .../0/0 public address was used for this.
Looking at the wallet on sparrow and on the blockchain we can see that the transaction has been confirmed and it is being displayed accordingly.
However, on the phoenix mobile app this is not the case. It still says that I own 0 bitcoin.
Does the wallet only display lightning balance ? If so, I find it a bit confusing.

https://mempool.space/address/bc1qe6pmy87gnh757thxak3fgcmelamepxxvka7jhx

Yes , Phoenix only displays your LN balance, see https://phoenix.acinq.co/faq#where-is-my-on-chain-balance.
On-chain funds are ignored, except for funds deposited to the Bitcoin address displayed in the Receive screen, where we are using a mechanism inspired by swap-in potentiam to make trustless 0-conf swaps to LN.


Wayland support roadmap

[ ] Basic support
[ ] Input events
[ ] Hints
[ ] GL versions
[ ] Monitors
[ ] Fullscreen

#577


VirusSeq export from CanCOGeN template: automate addition of % symbol to "coverage" value

In the VirusSeq export from the CanCOGeN template, the breadth of coverage value is exported as a string.
The VirusSeq schema requires a "%" symbol after the value, which currently has to be inserted manually by the curator.
The % symbol is part of the field definition and so not inserted in the DH or in NML LIMS.
Can we automate the addition of the "%" symbol after the value in the breadth of coverage export? e.g. 89 in the DH appears as 89% under breadth of coverage in the VirusSeq export?

Ok, done, and on branch "vocabulary update" shortly.


Fix for default executor value setting

[x] I have added the tests to cover my changes.
[x] I have updated the documentation and CHANGELOG accordingly.
[x] I have read the CONTRIBUTING document.

Same CodeCov bug as in #1251 .


feat: add password Item forcibly when PasswordOn enabled

Signed-off-by: sh1luo<EMAIL_ADDRESS>

Demo link: http://<IP_ADDRESS>:8000/


Two functions same docs

There are two functions, _initterm and _initterm_e, however there is only a difference in some weird pointer names

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: c9b9551b-39c9-c4e9-bb64-7a702fac3baf
Version Independent ID: d3ff44f5-4b0e-ea77-0253-209f8162e8ec
Content: _initterm, _initterm_e
Content Source: docs/c-runtime-library/reference/initterm-initterm-e.md
Product: visual-cpp
Technology: cpp-ucrt
GitHub Login: @TylerMSFT
Microsoft Alias: twhitney

_initterm returns a void (i.e., nothing), _initterm_e returns an int result code as specified in the description.

Thanks, @orcmid. I hope you had a relaxing holiday.
Closing this.