SQLiteDatabaseCorruptException and Need of cbljavasqlitecustom and sqlite3.

Hi Folks,
1)public static final String JNI_SQLITE_CUSTOM_LIBRARY = "cbljavasqlitecustom";
private static final String SHARED_SQLITE_LIBRARY = "sqlite3";
AFAIK above libs are required only when android devices won’t come with default inbuilt stock device SQLITE lib..
2)CBL 1.4 used with SQLITE storage options.
3)When using encryption option to DB below exception is seen only in some devices.
database: SQLiteDatabase: Failed to open database '/data/data/com.company.ui/files/ptxdata.cblite2/db.sqlite3'.
                                                         ```
com.couchbase.lite.internal.database.sqlite.exception.SQLiteDatabaseCorruptException: file is encrypted or is not a database (code 26): , while compiling: SELECT count(*) FROM sqlite_master
                                                             at com.couchbase.lite.internal.database.sqlite.SQLiteConnection.nativePrepareStatement(Native Method)
                                                             at com.couchbase.lite.internal.database.sqlite.SQLiteConnection.acquirePreparedStatement(SQLiteConnection.java:718)
                                                             at com.couchbase.lite.internal.database.sqlite.SQLiteConnection.executeForLong(SQLiteConnection.java:522)
                                                             at com.couchbase.lite.storage.SQLiteStorageEngineBase.decrypt(SQLiteStorageEngineBase.java:126)
                                                             at com.couchbase.lite.storage.SQLiteStorageEngineBase.access$200(SQLiteStorageEngineBase.java:32)
                                                             at com.couchbase.lite.storage.SQLiteStorageEngineBase$ConnectionListener.onOpen(SQLiteStorageEngineBase.java:96)
                                                             at com.couchbase.lite.internal.database.sqlite.SQLiteConnection.open(SQLiteConnection.java:198)
                                                             at com.couchbase.lite.internal.database.sqlite.SQLiteConnection.open(SQLiteConnection.java:178)
                                                             at com.couchbase.lite.internal.database.sqlite.SQLiteConnectionPool.openConnectionLocked(SQLiteConnectionPool.java:461)
                                                             at com.couchbase.lite.internal.database.sqlite.SQLiteConnectionPool.open(SQLiteConnectionPool.java:191)
                                                             at com.couchbase.lite.internal.database.sqlite.SQLiteConnectionPool.open(SQLiteConnectionPool.java:183)
                                                             at com.couchbase.lite.internal.database.sqlite.SQLiteDatabase.openInner(SQLiteDatabase.java:820)
                                                             at com.couchbase.lite.internal.database.sqlite.SQLiteDatabase.open(SQLiteDatabase.java:803)
                                                             at com.couchbase.lite.internal.database.sqlite.SQLiteDatabase.openDatabase(SQLiteDatabase.java:698)
                                                             at com.couchbase.lite.storage.SQLiteStorageEngineBase.open(SQLiteStorageEngineBase.java:70)
                                                             at com.couchbase.lite.store.SQLiteStore.open(SQLiteStore.java:188)
                                                             at com.couchbase.lite.Database.open(Database.java:1369)
                                                             at com.couchbase.lite.Manager.openDatabase(Manager.java:341)

Thanks
Nithin

@hideki please share your thoughts..

Hi @NitzDKoder,

Android  N or higher, it does not allow the application to access system native libraries including sqlite. So  CBL Android always use Couchbase compiled sqlite library.

About SQLiteDatabaseCorruptException, I assume SQLite with encryption tries to open the SQLite databsae file that is created by SQLite without Encryption.

@hideki

ah missed this topic..thanks for the info.. strange part is  i dont include theae as part libs and android N and O works..
Will update how its working..

2)Have this problem in 4.4.4 when i include these library... how do i go by now??
PS: i dont use gradle build..instead add libs and jar on my own..

@hideki

We do this https://github.com/couchbase/couchbase-lite-java-core/issues/1641

After loading DB with encryption fails.

10-16 18:19:08.024 D/Database(22471): ### Couchbase Lite devbuild (devbuild) ###

10-16 18:19:08.029 D/Database(22471): setFilterCompiler: com.couchbase.lite.javascript.JavaScriptReplicationFilterCompiler@425a2f00

10-16 18:19:08.030 D/Database(22471): getDatabase() com.couchbase.lite.Manager@42c1a170 <EMAIL_ADDRESS>
10-16 18:19:08.030 D/Database(22471): Opening<EMAIL_ADDRESS>
10-16 18:19:08.033 D/dalvikvm(22471): Trying to load lib /data/app-lib/com.my.product-1/libCouchbaseLiteJavaForestDB.so 0x42511720

10-16 18:19:08.041 D/dalvikvm(22471): Added shared lib /data/app-lib/com.my.product-1/libCouchbaseLiteJavaForestDB.so 0x42511720

10-16 18:19:08.043 D/dalvikvm(22471): Trying to load lib /data/app-lib/com.my.product-1/libsqlcipher.so 0x42511720

10-16 18:19:08.043 D/dalvikvm(22471): Shared lib '/data/app-lib/com.my.product-1/libsqlcipher.so' already loaded in same CL 0x42511720

10-16 18:19:08.043 D/dalvikvm(22471): Trying to load lib /data/app-lib/com.my.product-1/libcbljavakey.so 0x42511720

10-16 18:19:08.044 D/dalvikvm(22471): Shared lib '/data/app-lib/com.my.product-1/libcbljavakey.so' already loaded in same CL 0x42511720

10-16 18:19:08.044 D/dalvikvm(22471): Trying to load lib /data/app-lib/com.my.product-1/libcbljavasqlcipher.so 0x42511720

10-16 18:19:08.044 D/dalvikvm(22471): Shared lib '/data/app-lib/com.my.product-1/libcbljavasqlcipher.so' already loaded in same CL 0x42511720

10-16 18:19:08.045 D/Database(22471): Successfully load native library: cbljavasqlcipher

10-16 18:19:08.046 D/dalvikvm(22471): Trying to load lib /data/app-lib/com.my.product-1/libsqlcipher.so 0x42511720

10-16 18:19:08.046 D/dalvikvm(22471): Shared lib '/data/app-lib/com.my.product-1/libsqlcipher.so' already loaded in same CL 0x42511720

10-16 18:19:08.047 D/dalvikvm(22471): Trying to load lib /data/app-lib/com.my.product-1/libcbljavakey.so 0x42511720

10-16 18:19:08.047 D/dalvikvm(22471): Shared lib '/data/app-lib/com.my.product-1/libcbljavakey.so' already loaded in same CL 0x42511720

10-16 18:19:08.047 D/dalvikvm(22471): Trying to load lib /data/app-lib/com.my.product-1/libcbljavasqlcipher.so 0x42511720

10-16 18:19:08.047 D/dalvikvm(22471): Shared lib '/data/app-lib/com.my.product-1/libcbljavasqlcipher.so' already loaded in same CL 0x42511720

10-16 18:19:08.048 D/Database(22471): Successfully load native library: cbljavasqlcipher

10-16 18:19:08.049 D/Database(22471): SQLiteStore: encryption not available (app not built with SQLCipher)

10-16 18:19:08.050 V/AlarmManager(  944): sending alarm Alarm{433705f8 type 2 android}

10-16 18:19:08.052 D/CouchBaseLiteManager(22471): Encryption not available

10-16 18:19:08.052 W/System.err(22471): com.couchbase.lite.CouchbaseLiteException: Encryption not available, Status: 501 (HTTP 501 Not Implemented)

Please share your thoughts..
Thanks
Nithin

@NitzDKoder,
Two possibilities:

encryption key is null
SQLCipher module is not loaded.
https://github.com/couchbase/couchbase-lite-java-core/blob/d18e1e0ccad317bf9e3285451e430c49e961b7bf/src/main/java/com/couchbase/lite/storage/SQLiteStorageEngineBase.java#L62-L66

Hi @NitzDKoder,
Do you have any updates about this issue?

@hideki
encryption key is null
Is not null.
SQLCipher module is not loaded.
It was loaded.
10-16 18:19:08.043 D/dalvikvm(22471): Trying to load lib /data/app-lib/com.my.product-1/libsqlcipher.so 0x42511720
10-16 18:19:08.043 D/dalvikvm(22471): Shared lib '/data/app-lib/com.my.product-1/libsqlcipher.so' already loaded in same CL 0x42511720
Still issue is SEEN.
Current Solution:
1)We use sqlite3 as part of our C engine.
2)Removed below libs.
public static final String JNI_SQLITE_CUSTOM_LIBRARY = "cbljavasqlitecustom";
private static final String SHARED_SQLITE_LIBRARY = "sqlite3";
3)CBL works in all devcies starting Android 4.1 to Android 8.0.

Hi @NitzDKoder,
It seems the app used customized CBL. And, as the app loaded sqlite3, it seems this library is used instead of sqlcipher.  It seems we can not do anything for this issue.
By customizing the code to load the library, the app might be able to force to load sqlcipher lib for CBL.

@hideki

How the encryption working in my app. using sqlcipher? sqlcipher on num 2 below?

https://github.com/couchbase/couchbase-lite-java-native
2)As we use sqlite3 as part of a C engine .SO. for internal sqlite DB support
a)is CBL using the same instance?
Thanks
Nithin

Hi @NitzDKoder,
sqlcipher  and sqlite3 native library's method signatures are same. So your app loads sqlite3. So even loads sqlcipher the app keeps using methods from sqlite3 native library.

@NitzDKoder,
As a workaround, I believe your app could use sqlcipher native library as your sqlite library. They should behave same if encryption is not enabled.

@hideki
1)[07/25 11:31:50:662] [264] Database: decrypt key: 1c2e19dd527ffb932960dc9eb32e7d72060ed27ee0bd133699e3983c94573670 ([28, 46, 25, -35, 82, 127, -5, -109, 41, 96, -36, -98, -77, 46, 125, 114, 6, 14, -46, 126, -32, -67, 19, 54, -103, -29, -104, 60, -108, 87, 54, 112])
[07/25 11:31:51:035] [264] Database: SQLiteStorageEngine {database=c30fc4c}: Opened Android sqlite db
1c2e19dd527ffb932960dc9eb32e7d72060ed27ee0bd133699e3983c94573670
Encrypted DB opened .
2)[07/25 13:03:28:133] [289] Database: Successfully load native library: cbljavasqlcipher
[07/25 13:03:28:148] [289] Database: Successfully load native library: cbljavasqlcipher
[07/25 13:03:28:627] [289] Database: decrypt key: 1c2e19dd527ffb932960dc9eb32e7d72060ed27ee0bd133699e3983c94573670 ([28, 46, 25, -35, 82, 127, -5, -109, 41, 96, -36, -98, -77, 46, 125, 114, 6, 14, -46, 126, -32, -67, 19, 54, -103, -29, -104, 60, -108, 87, 54, 112])
[07/25 13:03:28:682] [289] Database: Decrypting database failed
[07/25 13:03:28:869] [289] Database: Unauthorized to open the SQLite database
[07/25 13:03:28:870] [289] Database: Unable to create a storage engine
DB failed to decrypt using old decrypt key.
Please share your thoughts,.we see this issue very often..


Failure on AcmCertificateStack

This template fails for me consistently during the nested AcmCertificateStack (DomainValidationRecord CREATE_COMPLETE). It looks as though the DNS validation for the certificate hangs indefinitely (using root or an elevated admin account and from us-east1). In the certificate manager UI the new certificate's Validation Signature remains in a pending state until the stack fails completely and cleans out the entries.

I had a similar issue. I forgot to add .com to my DomainName

Hey Zachary, and thanks for answering my question. The issue I was having was related to DNS NS records generated by Route 53 pointing to different name servers than those used by the domain I registered using Route 53.
(Solution: Answer is somewhere near where user donblair chimes in)

Looks like your issue got solved. I'm going to close this for now.

@ConnorKirk that link is dead, I just ran this cloudformation using all the basic defaults, and had the exact same problem, CREATE_FAILED on the nested certificate step :(

Is there no way to mark fields required for these stacks? I left out the HostedZoneId, that's why it failed:


Wake word sound cue doesn't work for barge in

IMPORTANT: Before you create an issue, please take a look at our Issue Reporting Guide.
Briefly summarize your issue:

I've ported SDK to an embedded system and it works fine. For the wake word sound cue I added the line according to the solution described in https://github.com/alexa/avs-device-sdk/issues/514
What is the expected behavior?

I should hear the sound cue every time the wake word is detected.
What behavior are you observing?

I got sound cue initially, but for barge in, there is no sound cue after the wake word is detected.
Provide the steps to reproduce the issue, if applicable:

Using voice commend to activate story telling "Alexa, tell me a story."
Got sound cue and a story started.
After the story starts, barge in with voice command "Alexa, stop"
No sound cue, but the story stopped

Tell us about your environment:

After barge in the sound cue couldn't get play as the sound device was busy:
############################
Listening...
############################
2019-01-30 17:22:41.365 [  b] 0 AudioPlayer:executeProvideState:sendToken=true,s
tateRequestToken=3
2019-01-30 17:22:41.369 [  5] 0 MediaPlayer:handleGetOffsetCalled:idPassed=1,cur
rentId=1
2019-01-30 17:22:41.375 [  f] 0 AudioInputProcessor:executeOnContextAvailable:js
onContext={"context":[{"header":{"namespace":"VisualActivityTracker","name"
:"ActivityState"},"payload":{"focused":{"interface":"TemplateRuntime"}}},{"
header":{"namespace":"Alexa.PlaybackStateReporter","name":"playbackState"},
"payload":{"state":"IDLE","supportedOperations":[],"shuffle":"NOT_SHUFFLED
","repeat":"NOT_REPEATED","favorite":"NOT_RATED","positionMilliseconds":0
,"uncertaintyInMilliseconds":0,"players":[]}},{"header":{"namespace":"Exte
rnalMediaPlayer","name":"ExternalMediaPlayerState"},"payload":{"playerInFocu
s":"","players":[]}},{"header":{"namespace":"Notifications","name":"Indi
catorState"},"payload":{"isEnabled":false,"isVisualIndicatorPersisted":true
}},{"header":{"namespace":"Alerts","name":"AlertsState"},"payload":{"allA
lerts":[],"activeAlerts":[]}},{"header":{"namespace":"AudioPlayer","name"
:"PlaybackState"},"payload":{"token":"amzn1.as-ct.v1.Domain:Phatic:AlexaOr
iginals#ACRI#url#ACRI#AlexaOriginals|2575ff33-e242-45da-be19-3dd3a3776d6d|https
://dvi8md6049w6b.cloudfront.net/nina_v1_645641cfbc78aa785058__Stories_en_us_nina
new_spring_on_mars_128kb.mp3?Expires=1548897740&Signature=WjGeWMjb6LDXMP1LCIF
mtw1HO-aiqWPkWgTf3~VWJmswb0ogYBitq7VdZF4v2TQ4bLDEPJdRWC6gJhWsY~ocE~QNXznQBVRboMh
a3KYIbbMJdirR84mzx0MlNQg57JdvqGoThtOXsEkntiRr34KmZYOTu7XKCj8glDUzvcBcEHjBUf1BY2K
vQyHMHxcxopU5DfH~AydkOvhwYC245D1~W7rnnYzQcpQlhDMmOyjX7SHZQFTowBrRt4nEW-4F78t2NUg
Om-9RnQCuA8qBOOsBY8dAWq4n4egEKnmg4FEWgFTjAb2AGZ0eRex5AJkmqFqRDj7au9KqZtUbjJ~rOUu
6fA_&Key-Pair-Id=APKAJMAIYIGWWT37OIHA|A New Spring On Mars|1548868940582|ATVPD
KIKX0DER|A2B40NFEGFU0GP|en_US|Alexa3P:1.0/2019/01/30/17/c9ab1596dc4c4e018a25bc6
a8cedf6c2/22:18::TNIH_2V.8794389b-0836-461a-a1c5-1eb1eadad3b2ZXV/1|13aefe10-6
e0f-4242-944d-a898cdd1e3b2|PhaticIntent","offsetInMilliseconds":12277,"player
Activity":"PLAYING"}},{"header":{"namespace":"SpeechSynthesizer","name":"S
peechState"},"payload":{"token":"","offsetInMilliseconds":0,"playerActivit
y":"FINISHED"}},{"header":{"namespace":"Speaker","name":"VolumeState"},"p
ayload":{"volume":100,"muted":false}},{"header":{"namespace":"AudioActivi
tyTracker","name":"ActivityState"},"payload":{"content":{"interface":"Audi
oPlayer","idleTimeInMilliseconds":0}}}]}
2019-01-30 17:22:41.376 [  f] I DirectiveProcessor:setDialogRequestIdLocked:oldV
alue=ffe6d412-0937-40c0-8b20-c6c668938a37,newValue=c4fae9d8-e94d-4a40-a835-fd9d5
86abf69
2019-01-30 17:22:41.376 [  f] 0 DirectiveProcessor:scrubDialogRequestIdLocked:di
alogRequestId=ffe6d412-0937-40c0-8b20-c6c668938a37
2019-01-30 17:22:41.377 [  f] 0 EventBuilder:buildJsonEventString:messageId=37e1
ee59-0411-4482-a5a2-b5287f83ddd9,namespace=SpeechRecognizer,name=Recognize
2019-01-30 17:22:41.378 [ 14] 0 AudioPlayer:onFocusChanged:newFocus=BACKGROUND
2019-01-30 17:22:41.378 [  5] 0 MediaPlayer:handlePauseCalled:idPassed=1,current
Id=1
2019-01-30 17:22:41.393 [  5] 0 MediaPlayer:callingOnPlaybackPaused:currentId=1
2019-01-30 17:22:41.394 [  5] 0 AudioPlayer:onPlaybackPaused:id=1
2019-01-30 17:22:41.394 [  b] E ProgressTimer:setStateFailed:reason=notAllowed,s
tate=IDLE,newState=PAUSED
2019-01-30 17:22:41.394 [  b] E ProgressTimer:pauseFailed:reason=setStateFailed
2019-01-30 17:22:41.395 [  5] 0 MediaPlayer:handleGetOffsetCalled:idPassed=1,cur
rentId=1
2019-01-30 17:22:41.395 [  b] 0 EventBuilder:buildJsonEventString:messageId=46e2
c26f-1ea4-45e8-a348-253e07d9bf27,namespace=AudioPlayer,name=PlaybackPaused
2019-01-30 17:22:41.396 [  b] 0 AudioPlayer:changeActivity:from=PLAYING,to=PAUSE
D
2019-01-30 17:22:41.396 [  9] W LibcurlUtils:verificationOfHostsAndPeersDisabled
2019-01-30 17:22:41.396 [  b] 0 AudioPlayer:executeProvideState:sendToken=false,
stateRequestToken=0
2019-01-30 17:22:41.397 [  f] 0 AudioInputProcessor:executeOnFocusChanged:newFoc
us=FOREGROUND
aplay: main:722: 2019-01-30 17:22:41.730 [  5] 0 MediaPlayer:handleGetOffsetCall
ed:idPassed=1,currentId=1
audio open error: Device or resource busy
2019-01-30 17:22:41.731 [  5] 0 MediaPlayer:handleGetOffsetCalled:idPassed=1,cur
rentId=1
2019-01-30 17:22:41.733 [ 17] E JsonUtils:findNodeFailed:reason=missingDirectChi
ld,child=controls
What version of the AVS Device SDK are you using?
  <x.y.z>

1.10
Tell us what hardware you're using:

[ ] Desktop / Laptop
[ ] Raspberry Pi
[x] Other - tell us more:
Amlogic S805 based embedded system

Tell us about your OS (Type & version):

[x] Linux
[ ] MacOS
[ ] Raspbian Stretch
[ ] Raspbian Jessy
[ ] Other - tell us more:

Hi @charlesexu , try adding a dmix plugin as suggested in the troubleshooting guide. Look for the issue "Can't play more than one sound simultaneously".

Hi @charlesexu , I will be closing this issue due to inactivity. Let me know if you still need help on this case and we can reopen it. Thanks.


help wanted

hello
clone , npm install , and then npm run dev

everything is ok....but when open http://localhost:3000/  it show me blank chrome window....
I cant find it why ..I open another project to check if it is my laptop problem, my laptop is ok..
is there any dependencies i missing to install??

Can you check if there are any errors that you see on your browser console?

no errors in my browser ,,, just a blank white window, nothing show me ...

Not reproducible. Hence closing it.


docs on ng run should be discoverable from wiki

https://github.com/angular/angular-cli/wiki/run
should be listed under
https://github.com/angular/angular-cli/wiki#additional-commands

CLI commands are not on Angular.io
https://angular.io/cli


Issue when using a dataloader on MULTI_GPU

System Info
- `Accelerate` version: 0.18.0
- Platform: Linux-5.15.0-1023-aws-x86_64-with-glibc2.31
- Python version: 3.10.11
- Numpy version: 1.24.3
- PyTorch version (GPU?): 1.13.1 (False)
- `Accelerate` default config:
        - compute_environment: LOCAL_MACHINE
        - distributed_type: MULTI_GPU
        - mixed_precision: no
        - use_cpu: False
        - num_processes: 4
        - machine_rank: 0
        - num_machines: 1
        - gpu_ids: 0, 1, 2, 3
        - rdzv_backend: static
        - same_network: True
        - main_training_function: main
        - downcast_bf16: no
        - tpu_use_cluster: False
        - tpu_use_sudo: False
        - tpu_env: []

Information

[X] The official example scripts
[ ] My own modified scripts

Tasks

[ ] One of the scripts in the examples/ folder of Accelerate or an officially supported no_trainer script in the examples folder of the transformers repo (such as run_no_trainer_glue.py)
[X] My own task or dataset (give details below)

Reproduction
I am using accelerate to speed up the inference on a set of prompts. I sequentially receive batches of prompts, that I turn into a torch IterableDataset.  From that dataset I build a dataloader that I prepare as well as the model I am using. I am trying to run the inference by going through the prepared dataloader. As a matter of fact, I expect accelerate to dispatch my prompts through all my GPUs but I end up having an issue.
The problem arises in with the following code
from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline
from accelerate import Accelerator

import tqdm
import torch
from torch.utils.data import IterableDataset
from torch.utils.data.dataloader import DataLoader
import os

class TokenizedDataset(IterableDataset):
    """Tokenize and preprocess the dataset, where the dataset is a list of instructions (str)
    """
    def __init__(self, tokenizer, dataset):
        self.tokenizer = tokenizer
        self.dataset = dataset
        self.outputs = self.tokenizer(self.dataset, padding=True, return_tensors="pt")
    def __iter__(self):
        for i in range(len(self.dataset)):
            yield {
                "input_ids" : self.outputs.input_ids[i],
                "attention_mask" : self.outputs.attention_mask[i],
                "prompt" : self.dataset[i]
            }

if __name__ =="__main__" :
    os.environ["TOKENIZERS_PARALLELISM"]="false"
    model_ckpt = "bigcode/santacoder"

    model = AutoModelForCausalLM.from_pretrained(model_ckpt, trust_remote_code=True, torch_dtype=torch.bfloat16)
    tokenizer = AutoTokenizer.from_pretrained(model_ckpt)
    tokenizer.pad_token=tokenizer.eos_token
    accelerator = Accelerator()
    prompts = [
        "I am happy",
    ]
    batch_size=1
    tokenized_dataset = TokenizedDataset(tokenizer=tokenizer, dataset=prompts)
    dataloader = DataLoader(tokenized_dataset, batch_size=batch_size)

    model, dataloader = accelerator.prepare(model, dataloader)

    print("prepared dataloader")
    for step, batch in tqdm.tqdm(enumerate(dataloader)):
        with torch.no_grad():
            input_ids = batch["input_ids"]
            attention_mask = batch["attention_mask"]
            prompt = batch["prompt"]
            if input_ids.shape[0] == 0 :
                print("batch size = 0")
            print("step = "+str(step))
            print("input ids "+str(input_ids.shape))
            print("attention mask "+str(attention_mask))
            try :
                print("decoding : "+str(tokenizer.decode(input_ids[0])))
            except IndexError :
                print("An error occured")

Here my dataset has just one sentence (I am happy), but I have 4 GPUs. Knowing how accelerate works, I expect each GPU to have a duplicate of the sentence on it. However it is not the case. This is what I have in terms of error logs
prepared dataloader
step = 0
input ids torch.Size([1, 3])
attention mask tensor([[1, 1, 1]], device='cuda:0')
decoding : I am happy
prepared datalo
decoding : I am happy
prepared dataloader
batch size = 0
step = 0
input ids torch.Size([0, 3])
attention mask tensor([], device='cuda:2', size=(0, 3), dtype=torch.int64)
An error occured
tensor([], device='cuda:2', size=(0, 3), dtype=torch.int64)
prepared dataloader
batch size = 0
step = 0
input ids torch.Size([0, 3])
attention mask tensor([], device='cuda:3', size=(0, 3), dtype=torch.int64)
An error occured
tensor([], device='cuda:3', size=(0, 3), dtype=torch.int64)

As you would probably notice, cuda:0 and cuda:1 have the sentence, as expected (input_ids is a non empty tensor and its decoding leads to the original prompt I am happy.  However, cuda:2 and cuda:3 have empty tensors (you can notice An error occured which comes from the try except  which catch the error that comes from trying to decode an empty input_ids tensor.
I think the problem may come from how the last batch is handled when we dispatch the content of the dataloader in accelerate.
Expected behavior
I expected the tensors input_ids and attention_mask (corresponding to the sentence 'I am happy') to be duplicated across all my devices. Not just cuda:0 and cuda:1, but also cuda:2 and cuda:3.

I can't reproduce on my side as the prompt yielded in the batches make Accelerate fail: since this is is an iterable dataset, dispatch_batches is activated by default and the DispatchDataLoader can only deal with tensors. Once commenting out the prompt, everything works fine.

Thank you for your response. However I am quite surprised. Maybe It has to do with my version of accelerate. Even when I replaced "prompt" : self.dataset[I] by "index_prompt" : torch.tensor(i, dtype=torch.int8) the error remained.
prepared dataloader
batch size = 0
step = 0
input ids = torch.Size([0, 3])
attention mask = tensor([], device='cuda:2', size=(0, 3), dtype=torch.int64)
index prompt = tensor([], device='cuda:2', dtype=torch.int8)
An error occured
prepared dataloader
step = 0
input ids = torch.Size([1, 3])
attention mask = tensor([[1, 1, 1]], device='cuda:0')
index prompt = tensor([0], device='cuda:0', dtype=torch.int8)
decoding : I am happy
prepared dataloader
step = 0
input ids = torch.Size([1, 3])
attention mask = tensor([[1, 1, 1]], device='cuda:1')
index prompt = tensor([0], device='cuda:1', dtype=torch.int8)
decoding : I am happy
prepared dataloader
batch size = 0
step = 0
input ids = torch.Size([0, 3])
attention mask = tensor([], device='cuda:3', size=(0, 3), dtype=torch.int64)
index prompt = tensor([], device='cuda:3', dtype=torch.int8)
An error occured

The error also remains when I remove prompt and keep input_ids and attention_mask. The code work when I use 2 GPUs, but does not work when I use 4 GPUs or more. Can you check once again? I think it has to do with the size of dataset/batch compare to the number of GPUs used.

@muellerzr


FluentMessageBarProvider doesn't work in dark mode.

🐛 Bug Report
When using the FluentMessageBarProvider if switching to dark mode the messages displayed are unreadable.
🤔 Expected Behavior
Messages should change colour to be readable like the other components do.
😯 Current Behavior

This has been covered in a number of issues already. Are you using the FluentDesignTheme?

I thought I was but must be doing something wrong. Will look at the demo site source code


'Current Energy' Entity no longer available

Since upgrading to the latest version on Sunday 8 Jan, there are two entities no longer available. They were working earlier that day.
I'm afraid I'm quite new to Home Assistant and fairly inexperienced but I'm hoping that the information below is helpful.
Thank you.
Missing Entities
sensor.solar_socket_2_tapo_energy_monitor_plug_current_energy
and
sensor.solar_socket_2_tapo_energy_monitor_plug_this_month_energy
The first of these is the key one for me.
Error Message
"This entity is no longer being provided by the tapo integration. If the entity is no longer in use, delete it in settings."
Version of Integration
1.3.7 (but error first occurred in 1.3.6)
Tapo Device
P110
by TP-Link
Firmware: 1.1.6 Build 221114 Rel.203339
Hardware: 1.0
Log Entry
Logger: custom_components.tapo.common_setup
Source: helpers/update_coordinator.py:201
Integration: Tapo Controller (documentation, issues)
First occurred: 9 January 2023 at 6:53:10 pm (48 occurrences)
Last logged: 5:23:10 pm
Error fetching tapo data: Unexpected exception:
 <!-- Before you open a new issue, search through the existing issues to see if others have had the same problem.

Please read here https://github.com/petretiandrea/home-assistant-tapo-p100/issues/321#issuecomment-1374841158. Closed as duplicate of #321


[backend] Add oauth logic for Github/Twitter

Don't connect to database, just go through the flow and callback. Database connection/identity registration will be in a different task.

can we add reddit too?


Add more informative error messages.

I just came across the error message at:
https://github.com/TuringLang/AdvancedHMC.jl/blob/0814ae16a9f550bda9e4b3be5360b519bac5c144/src/hamiltonian.jl#L33
This error message should be more informative so that the user gets an idea why he gets it, i.e. in my case I suppose the model I'm looking at is misspecified. It would be good to know what is  Inf.

I don't think the error message could be informative to that level, but I can at least make it indicate in which part (position, mometum, potential energy or its gradient, kinect energy or itsgradient) the numerical issue occurs.

Closed by PR #79.


Budget counter is inaccurate

It counts each monthly donation separately in the first part of the query. https://github.com/OpenCollective/opencollective-api/blob/master/server/models/Group.js#L276

Fix: https://github.com/OpenCollective/opencollective-api/pull/473

Fixed: https://github.com/OpenCollective/opencollective-api/pull/477.

Fixed in the latest push.


I can not find “native BlzFrameAddText takes framehandle frame, string text returns nothing”

i can not find “native BlzFrameAddText takes framehandle frame, string text returns nothing”。
Did you forget it or something else？

Nope, Blizzard forgot them, they are not part of the game's common.j file which we simply extract.

thanks！

hi Frotty
i want to use this function，what can i do？

You can edit your common.j file and disable Pjass.
That's not recommended though.

thanks


CUIRA-284 disable autoscaling

Jira link (if applicable)
CUIRA-284
Change description
Disable hpa autoscale, set reasonable resource requests

Not needed, as resource control should be in cnp-flux-config


Fix a little typo (missing closing brace)

While I'm at it, here's the most minor of nitpicks :)
This is just what I noticed while reading the guides, I'm completely new to Thymeleaf. Thanks for putting so much care into this!

👍


Add GitHub Security Alerts Component

Describe the solution you'd like
There's a new box containing GitHub Security Alerts.

There doesn't seem to be a need for this. The issue could be reopened if requested.


GEODE-7308: upgrade Jetty to a newer version

Thank you for submitting a contribution to Apache Geode.
In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:
For all changes:

[x] Is there a JIRA ticket associated with this PR? Is it referenced in the commit message?

[x] Has your PR been rebased against the latest commit within the target branch (typically develop)?

[x] Is your initial contribution a single, squashed commit?

[x] Does gradlew build run cleanly?

[ ] Have you written or updated unit tests to verify your changes?

[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?

Note:
Please ensure that once the PR is submitted, check Concourse for build issues and
submit an update to your PR as soon as possible. If you need help, please send an
email to<EMAIL_ADDRESS>

On #4104 I skipped this upgrade because it was causing RestAPIsWithSSLDUnitTest to fail with a cert error.  If you can figure that out it would be great!

@mkevo I think the SSL failures can be fixed by switching SSLContectFactory to SSLContextFactory.Server as per these Jetty issues:
https://github.com/eclipse/jetty.project/issues/3464
https://github.com/eclipse/jetty.project/issues/3466
https://github.com/eclipse/jetty.project/issues/3554

@mkevo I think the SSL failures can be fixed by switching SSLContectFactory to SSLContextFactory.Server as per these Jetty issues:
eclipse/jetty.project#3464
eclipse/jetty.project#3466
eclipse/jetty.project#3554

Thanks for an advice! I will take a look on it.


eza: themes

Quite recently, added support for theme files (see i.e. https://github.com/eza-community/eza/pulls?q=is%3Apr+themes+is%3Aopen).
AFAIK, these changes are so far only on git and there has to be a public release with theme support, but it would be nice to support it in stylix when it comes available.

Changing terminal colors also changes eza colors if I'm not mistaken. In the context of stylix (where everything is styled the same), is it really useful?


Error ExchangeOnlineManagement v3.2.0 Get-EXOMailbox returns Error 500

I get the following error on the newly installed ExchangeOnlineManagement PowerShell v3.2.0 cmdlet:
Get-EXOMailbox : Error while querying REST service. HttpStatusCode=500 ErrorMessage={"error":{"code":"InternalServerErr
or","message":"The call to Microsoft Exchange Active Directory Topology service on server 'TopologyClientTcpEndpoint (l
ocalhost)' returned an error. Error details Active Directory server  is not available. Error message: Active directory
response: The LDAP server is unavailable..","innererror":{"message":"The call to Microsoft Exchange Active Directory To
pology service on server 'TopologyClientTcpEndpoint (localhost)' returned an error. Error details Active Directory serv
er  is not available. Error message: Active directory response: The LDAP server is unavailable..","type":"Microsoft.Exc
hange.Data.Directory.ADTransientException"}}}}

It did work on v3.1.0 as both the Connect-ExchangeOnline and Connect-IPPSSession have problems.
Is it an issue with the cmdlet?
For now the workaround is to downgrade to 3.1.0 because it works on there as it does not use the REST service entirely.
~LvdW

@asterictnl-lvdw, you should open a support ticket about this. I just upgraded to v3.2.0 and it works fine in my Microsoft 365 E5 tenant.

@chrisda When you manually login with connect and the ipps it works. But if you have it in a script it doesn't work. I shall put a reproduction script in the next reply.

Please save this as a .ps1 file and run it as you normally should:
$Username =<EMAIL_ADDRESS>#Change the Username here
# In the new version IPPSSession can hide the banner now as well as a Banner shows up at the moment!
Connect-ExchangeOnline -UserPrincipalName $Username -ShowBanner:$false
Connect-IPPSSession -UserPrincipalName $Username -ShowBanner:$false
#When executing one or both it might already give an error about an instance object, unknown why that happens.
		$ExchangeSetting = Get-SharingPolicy | Where-Object { $_.Domains -like '*CalendarSharing*' }
		$affectedmailboxes = @()
		$mailboxes = Get-EXOMailbox -ResultSize Unlimited  #Here is where the timeout should occur
		foreach ($mailbox in $mailboxes)
		{
			# Get the name of the default calendar folder (depends on the mailbox's language)
			$calendarFolder = [string](Get-ExoMailboxFolderStatistics $mailbox.PrimarySmtpAddress -FolderScope Calendar | Where-Object { $_.FolderType -eq 'Calendar' }).Name
			# Get users calendar folder settings for their default Calendar folder # calendar has the format identity:\<calendar folder name>
			$calendar = Get-MailboxCalendarFolder -Identity "$($mailbox.PrimarySmtpAddress):\$calendarFolder"
			if ($calendar.PublishEnabled)
			{
				Write-Warning "Calendar publishing is enabled for $($mailbox.PrimarySmtpAddress) on $($calendar.PublishedCalendarUrl)"
				$affectedmailboxes += "Calendar publishing is enabled for $($mailbox.PrimarySmtpAddress) on $($calendar.PublishedCalendarUrl)"
			}
		}

@chrisda
Could you confirm you get NO errors if you run this in a .ps1 script.
Please let me know.
~LvdW

@chrisda
Also here the prove of pasting this above script into a new .ps1 file and run it from the command line.

@asterictnl-lvdw, I ran your script and got the timeout error.
I see your script is connecting to ExO PowerShell and S&C PowerShell at the same time. There was another issue about this that was never resolved.
When I used your script to connect to ExO PowerShell only, I didn't get the timeout error. It found a user where calendar sharing was enabled, but the script never seemed to end (I had to CTRL+C to get out of it).
Now that v3.2.0 is Generally Available (GA), you can and should open a support ticket about this issue, which seems to be more about connecting to ExO and S&C PowerShell in the same session.

@chrisda it's a pity that Microsoft doesn't take this issue seriously and it seems to only happen in version 3.2.x since they changed something about the authentication schema. I will send the data to the email address which is in the other issue and keep this issue updated.
To be continued...

This same issue happens to me on two separate computers. It only happens when I connect to EXO and Compliance PowerShell in the same console session. This just started happening last week, and I've had EXO V3.2 installed for three weeks.

Try running the Connect-IPPSSession first and then the Connect-ExchangeOnline if you need both connections. It looks like the Connect-IPPSSession cmdlet clobbers something in the ExchangeOnline connection if run in the opposite order ¯_(ツ)_/¯
Connect-IPPSSession -UserPrincipalName $Username -ShowBanner:$false -Verbose
Connect-ExchangeOnline -UserPrincipalName $Username -ShowBanner:$false -Verbose
Disconnect-ExchangeOnline -Confirm:$false


(vim)(#2147) Add note about AV detections

Description
Added a note about the VirusTotal AV detections to the package description. I also removed a note just pointing to the GitHub page as that is covered in package metadata.
Motivation and Context
The package cannot be approved on the Chocolatey Community Repository due to a high AV detections count. This will allow the package to be exempted.
How Has this Been Tested?
This is a README change so no testing done.
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Migrated package (a package has been migrated from another repository)

Checklist:

[x] My code follows the code style of this repository.
[x] My change requires a change to documentation (this usually means the notes in the description of a package).
[x] I have updated the documentation accordingly (this usually means the notes in the description of a package).
[x] I have updated the package description and it is less than 4000 characters.
[x] All files are up to date with the latest Contributing Guidelines
[ ] The added/modified package passed install/uninstall in the chocolatey test environment.
[x] The changes only affect a single package (not including meta package).

:white_check_mark: Package verification completed without issues. PR is now pending human review


Custom HTTP methods

⚠ Please verify that this feature request has NOT been suggested before.

[X] I checked and didn't find similar feature request

🏷 Feature Request Type
Other
🔖 Feature description
I'm looking to use a custom HTTP method in a HTTP check. Currently it seems there is a hardcoded list of supported methods, it would be great if we can define a custom HTTP method, so we can monitor non conventional HTTP applications (for example Microsoft remote desktop gateway).
✔ Solution
Add a field in the dropdown menu that allows a custom value.
❓ Alternatives
No response
📝 Additional Context
No response

I don't think adding support for "non conventional HTTP applications" is a reasonable feautre. These applications should have a separate monitor. If you/somebody else wants to implement such a montior, here is our contribution guide: https://github.com/louislam/uptime-kuma/blob/master/CONTRIBUTING.md


Expand/Colapse bug

Please remove expand click listener from xml parent on ParentViewHolder. Let user to decide what view will deal with that process.

@Cataalinn The click listener built into ParentViewHolder is for convenience and can be overridden by overriding ParentViewHolder.shouldItemViewClickToggleExpansion. Does this answer your question?

@dgreenhalgh Kind of, but i need to read the documentation to know that as first time use. In my opinion is better if is false by default.

@Cataalinn Thank you for the suggestion, if this comes up more often we'll consider changing it.
Since this library is meant to give a quick path for an expandable RecyclerView, it seems relevant to keep the default behaviour for developers first starting with this library.


self-balancing architecture

This is a really awesome feature we're looking to add. Super hard problem also if any ninjas want to try to tackle it :)  (you'll be legendary haha).
 Thus can't do any distributed training currently available (even in PyTorch).
But... we can break up the model and put parts on each GPU. The trick though is to do it automatically, because manually doing this is a PITA (trust me, i spend weeks dealing with this haha).
Proposed solution:
User hook in LightningModule where user returns the modules they want balanced.

class MyModule(LightningModule):
    def __init__(...):
        self.model_a = SomeModel()
        self.layer_1 = Linear(...)
        self.layer2 = Linear(...)

    def forward(x):
       # in each of these module calls, auto place the input x on the gpu of the module
        x = self.model_a(x)

       # in each of these module calls, auto place the input x on the gpu of the module
        x = self.layer_1(x)

       # in each of these module calls, auto place the input x on the gpu of the module
        x = self.layer_2(x)
        return x

    def self_balance():
        return [self.model_a, self.layer_1, self.layer_2]

So the above does two cool things:

user says how they want to break up the model.
In the forward, we auto put the input on that module's GPU.

That's the easy part lol... the hard part is deciding how to balance... optimizing for speed so you minimize data transfer across GPUs while not blowing up the RAM and using the RAM efficiently.
Anyone want to give this a shot?

Could use something similar to this to approximate mem usage per layer/module and then balance accordingly.

that’s helpful. You also beed to account for the size of the inout and output including taking batch size into account. sometimes the problem is that the layer output blows up the ram. so we’d need to probably try catch a few passes through each block and calculate its full memory requirement.
the memory requirement is weights + input + output. and gpu 0 has added overhead of optimizer which in case of adam has the grads

Something else that would be very appreciated (and in a similar vein) would be automatic out of memory exception handling for variable size batches. For instance, in something like a seq2seq model where the inputs can be arbitrarily large, it would be nice to be able to automatically (or through a provided hook) split the batch up (ala the batch accumulation) so each sub-batch now fits in memory.

@SeanNaren, Fairscale should partially provide this feature with OSS right ?

@tchaton, not exactly! This is covered by https://github.com/PyTorchLightning/pytorch-lightning/pull/4443 which introduces the pipe accelerator (allows you to split a model across GPUs). The self balancing part isn't easy, but can be done via functions like this in fairscale:
https://github.com/facebookresearch/fairscale/blob/7c5203eb772d7c67e45ed6ff6b66579b8e5cbc6c/fairscale/nn/pipe/balance/__init__.py#L100
I've been looking into the pipe accelerator but there are a few nice changes coming up with this PR: https://github.com/facebookresearch/fairscale/pull/156
Would be nice to get them in first before adding the plugin/accelerator for this :)

Has there been any progress on this feature? I see that there’s a Beta section on the documentation here: https://pytorch-lightning.readthedocs.io/en/latest/multi_gpu.html#model-parallelism-beta but I don’t know if this works with DDP

A lot has changed since this issue, and I'd like to summarize:
There are two ways to consider scaling architectures

Split layers onto devices manually
Split all layers equally onto devices

1 is extremely difficult to get right when architectures are large and complicated and to maintain effeciency. 2 which in recent years via DeepSpeed and now FairScale are more prominent, offer an elegant way to scale model architecture with minimal annotation.
Fully Sharded Data Parallel has been merged, and offers the ability to leverage 2 and in most cases, solve the underlying scaling issue. I have a PR for FSDP documentation #7791 which will hopefully explain more as to how this works :) Once merged, we should be able to close this!


Add support for selecting slave nodes

Currently there doesn't seem to be an ability to target a slave node. Would be great to have the ability to specify a slave node restriction similar to how a jenkins job can be restricted to run only on a slave or set of slaves.

Take a look at https://github.com/palantir/stashbot/issues/12. It looks like you can use labels to restrict jobs to a particular set of nodes.


Subject protocol-level types to versioning

To allow for the possibility of protocol upgrades, protocol-level types need to be handled in such a way that manual action is not required for a node to be compliant with a pending upgrade.
Typically this would be done by adding numbers to the names of our types, such as $block-0, $txn-0, etc.
Because %token aims to be kelvin-versioned, we may want to consider counting down from the Hoon version of each type. Ex. $block-139, $txn-139.
We also may want to consider handling the versioning at a different level from usual, such as in the name of the .hoon file. Ex. /sur/token-139/hoon.

See vanes (e.g. Ames) for examples of upgrade arms as well, which sequester the logic as necessary.


Increase scheduling frequency of sync:effortsheet command

Describe the task
Currently we're running the sync effortsheet command 2 times a day 9 AM and 10 PM. We need to increase this frequency maybe 6 times a day i.e every 4 hours.
Why we need this
Currently we facing many issues related to team members putting their previous day effort on next day after 10 PM, due to which their efforts are not captured and their FTE is coming less in the portal as the command only runs twice a day. So they have to wait for the next scheduling timing i.e 9 PM for their effort to get updated in portal till then their FTE comes less.
To reduce this issue we can increase the command scheduling frequency. Instead of running it twice in a day we can run it every four hours.
Expected behavior

[ ] Schedule the command to run at different timings i.e (00:30, 04:30, 08:30, 12:30, 16:30, 20:30)

References
You can take reference from this document: https://laravel.com/docs/9.x/scheduling

The task is complete


Adding the ability to specify custom next and prev arrow elements

This allows you to pass in custom next and prev elements as props.

I will review this pull request soon

Thanks. I new to react, so I'm not sure if this is the best way to accomplish this. It requires something like this:
var prevArrow = React.createClass({

  render: function() {
    return <button {...this.props}>Previous</button>
  }

})

<Carousel prevArrow=prevArrow>

One

Two

Three

</Carousel>

Note that this.props has to be passed to the element. At the least, I probably should have added an update to the documentation.

@akiran just wanted to see what you thought about this PR.

@ryanbagwell, Sorry. I couldn't get to this because of other tasks.
I will definitely review this PR and merge it this weekend.

awesome, thank you.

@akiran sorry about that. I pushed a fix. Thanks for letting me know.

@ryanbagwell  Thanks for the pull request.

Is there an example implementation of this?

I should have included one in the readme. You basically pass in react components as props with names prevArrow and nextArrow.

I don't believe there is any documentation and I have yet to reverse engineer the source https://github.com/akiran/react-slick/commit/cfb1c3212c50e34a7e4df1b226447e86db9b488c.
I have tried
// inline
<Slick nextArrow={<button></button>}></Slick>

// settings
var settings = {
  nextArrow={<button></button>}
};

<Slick {...settings}></Slick>

Seems that https://github.com/akiran/react-slick/blob/44ae518cd08fc4fd7d5523738591832a5e4d5711/src/arrows.jsx#L31 only accepts a string to modify the tag name (which doesn't seem that useful).

Anyways, I am looking into https://github.com/akiran/react-slick/blob/44ae518cd08fc4fd7d5523738591832a5e4d5711/src/inner-slider.jsx#L78, but figured I would ask.

Your example should work. Not sure if you need brackets around your button component.

@chemoish see my comment on March 24 and note the part about passing this.props to your button component.

@ryanbagwell, I tried your code, but it doesn't seem to satisfy the use case (Correct me if I am wrong—Thanks for the response btw).
let NextArrow = React.createClass({
    render() {
        return (
            <button className="slick-arrow" {...this.props}>Next</button> // need a slick-arrow class
        );
    }
});

The current implementation allows you to override the tag as well as the innerHTML. It also allows you to add default props (Both inline or configured).
However, it doesn't allow you to extend properties that are hard coded in https://github.com/akiran/react-slick/blob/44ae518cd08fc4fd7d5523738591832a5e4d5711/src/arrows.jsx#L69.

Solution 1: Copy pasta https://github.com/akiran/react-slick/blob/44ae518cd08fc4fd7d5523738591832a5e4d5711/src/arrows.jsx#L42 and pass that in as a prop (Bad).
Solution 2: ???


Fix feature = "thin": Remove defines to disable x2 and long seq

Fix https://github.com/cargo-bins/cargo-binstall/pull/768 and add regression test.

@gyscos Can you create a new minor release for this bug fix please?

This was released as part of zstd-sys 2.0.7.

Thanks!


Creates The Beneath mod as a moon requiring Oxygen

Minecraft Version:
1.12.2
Forge Version:
2559
Advanced Rocketry Version:
AdvancedRocketry-1.12.2-1.2.6-27
LibVulpes Version:
LibVulpes-1.12.2-0.2.6-16-universal
is this the latest curseforge build? Yes
#Please Pastebin crash
Crash Report:
Explain issue in detail:
Advanced Rocketry claims the Beneath dimension as a moon biome and puts it to require oxygen and world gen does not work.

Does this only happen with the Beneath mod and Advanced Rocketry and LibVilpes? can you check the planetDef.xml for any dimension that is matching the dimension of the Beneath dimension?  I know that can cause issues. if needed please pastebin your planetDef.xml and the Beneah mod's config and i can take a look.

I have similar issue at the end, there is no oxygen.
I'm playing a mod pack 'Modern Skyblock2'. I guess, that mod pack updates Advanced Rocketry versions many times, so dimension IDs are conflicted. The end dimension ID '1' and the space station dimension ID '1'? are assigned same one on planetDefs.xml.
saves/World/advRocketry/planetDefs.xml
https://pastebin.com/Z28gdJdP
Correctly, the end dimension is 1, the space station dimension is -2. I try rewriting from <planet name="Space" DIMID="1"> to <planet name="Space" DIMID="-2">, but it's restored when I start game.
If you know how to rewrite planetDefs.xml, or planetDefs.xml has no problem and I should fix the other files, please tell me.
thank you.

@arlyanagi It should take if you change the xml config.  Are you writing the file only when the game is completely shutdown and saving it before launch?

@zmaster587 Yes, I rewrote that file when the game process was killed. And, it restored when loading world data.
I tried:

rewriting line:24 from DIMID="1" to DIMID="-2", then the end is no oxygen, and the file is restored.
removing the lines 24-34 to reset data, then the game is crushed when loading world data.

Anyway, the oxygen came back at the end of my world. I did't fix any xml files and not update AdvancedRocketry/LibVulpes jars.
I did:

Start the game at over world
Go to the end, there is no oxygen and no breathable warning
Save and quit the game
Delete the end dimension directories, saves/World/DIM1 and saves/World/advRocketry/DIM1
Start the game at the end, there is oxygen and breathable

Current saves/World/advRocketry/planetDefs.xml
https://pastebin.com/NQSQdmh7
Now, I have no problem at overworld(breathable), the end(breathable) and space station(not breathable). I don't know why, but existing saves/World/advRocketry/DIM1 might be a cause. That directory is invalid and not created in my current world data.

Is this still a issue? Please comment if it is and i will reopen if if you are unable? We are closing old issues to see what is still relevant and needs to be fixed.


Converge  and [md-tab-nav-bar] pagination implementation

Bug, feature request, or proposal:
Feature Request
What is the expected behavior?
For the "md-tab-nav-bar" directive, I would expect when the number of links exceeds the horizontal space available, for pagination arrows to appear and the the height to remain fixed, like the behavior in <md-tab-group>.
What is the current behavior?
Currently elements not fitting onto one row reflow into a second row, while the ink bar remains under the second row.
What are the steps to reproduce?
http://plnkr.co/edit/1wWoGqoX9lOVlBT1c8Pg?p=preview
What is the use-case or motivation for changing an existing behavior?
UI interface of both implementations should be the same.
It's a really nice feature to able to use the Angular router with the md-tab-group styling, but it would be even better if the UI interface was identical.
Which versions of Angular, Material, OS, TypeScript, browsers are affected?
All
Is there anything else we should know?

See https://github.com/angular/material2/issues/2177

Duplicate of #2177


cargo-run-bin: 1.6.1 -> 1.7.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/project/cargo-run-bin/versions.
meta.description for cargo-run-bin is: Build, cache, and run binaries scoped in Cargo.toml rather than installing globally. This acts similarly to npm run and gomodrun, and allows your teams to always be running the same tooling versions
meta.homepage for cargo-run-bin is: https://github.com/dustinblackman/cargo-run-bin
meta.changelog for cargo-run-bin is: https://github.com/dustinblackman/cargo-run-bin/blob/v1.7.0/CHANGELOG.md
Updates performed

Rust version update

To inspect upstream changes
Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 1.7.0 with grep in /nix/store/1icp2gi04ax1p6p5gh5kzli0s5ysa9pd-cargo-run-bin-1.7.0
found 1.7.0 in filename of file in /nix/store/1icp2gi04ax1p6p5gh5kzli0s5ysa9pd-cargo-run-bin-1.7.0

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
cargo-run-bin

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/1icp2gi04ax1p6p5gh5kzli0s5ysa9pd-cargo-run-bin-1.7.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A cargo-run-bin https://github.com/r-ryantm/nixpkgs/archive/dffd27e489225425b3991df87ea868b7a6f9c9ef.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/dffd27e489225425b3991df87ea868b7a6f9c9ef#cargo-run-bin

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/1icp2gi04ax1p6p5gh5kzli0s5ysa9pd-cargo-run-bin-1.7.0
ls -la /nix/store/1icp2gi04ax1p6p5gh5kzli0s5ysa9pd-cargo-run-bin-1.7.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

cargo-run-bin

Maintainer pings
cc @mightyiam @matthiasbeyer for testing.

I wouldn't, TBH.


Issue adding sound effect files

Hey, I've been trying to fix this issue myself but have had no luck. Adding sound effects via Discord doesn't seem to be working.

Traceback (most recent call last):
  File "c:\users\joshua\documents\audrey\redenv\lib\site-packages\discord\ext\commands\core.py", line 79, in wrapped
    ret = await coro(*args, **kwargs)
  File "C:\Users\Joshua\AppData\Local\Red-DiscordBot\Red-DiscordBot\data\Audrey\cogs\CogManager\cogs\sfx\sfx.py", line 214, in addsfx
    audio_data = pydub.AudioSegment.from_file(filepath, format=file_extension[1:])
  File "C:\Users\Joshua\AppData\Local\Red-DiscordBot\Red-DiscordBot\data\Audrey\cogs\Downloader\lib\pydub\audio_segment.py", line 665, in from_file
    info = mediainfo_json(orig_file)
  File "C:\Users\Joshua\AppData\Local\Red-DiscordBot\Red-DiscordBot\data\Audrey\cogs\Downloader\lib\pydub\utils.py", line 263, in mediainfo_json
    res = Popen(command, stdin=stdin_parameter, stdout=PIPE, stderr=PIPE)
  File "C:\Python38\lib\subprocess.py", line 854, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "C:\Python38\lib\subprocess.py", line 1307, in _execute_child
    hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
FileNotFoundError: [WinError 2] The system cannot find the file specified

And I can't just put them all into the correct folder of the guild ID, it doesn't detect them. It does however, when I do ;addsfx put it into that folder. It just can't play it afterwards or see it using ;allsfx.

I suspect this is the same as #15. Install FFmpeg, add it to your path and see if that fixes it.

Thanks that fixed it :)


Formation image not accurate for fleets less than size 6

@bcc32 could you provide more details about this issue? For example, how many ship does the opponent's fleet has? Which outcome is expected?

I was thinking it should've been 6 opponents since we hide the circles if the spot isn't occupied. but it could be a matter of loading images from photobucket
iirc I was fixing this before, but ran out of test options, no more PvP enemies less than 6 so I postponed the test, and totally forgot afterwards :v

Enemy fleet size was 1.

i think it's fixed on latest dev's build. tried it and it shows properly

i think so too, tbh I forgot what I did but I was sure I was editing code and testing, might have been fixed at that time already. will close, and just re-open if v13 webstore still has it


Avoid printing to the console when registering a GType.

This just switches to Debug.WriteLine, similar to other classes like ObjectMapper.
I also searched for other print statements and this seems to be the only one printing to the console, outside of the samples.
Fixes: #844

[x] I agree that my contribution may be licensed either under MIT or any version of LGPL license.

Looks good. Thank you 🙏


YouCompleteMe unavailable but vim in CLI works

I installed the macvim with brew cask install macvim and vim with brew install vim --with-override-system-vi --with-lua. I compiled YCM after comment the conda path in the bash_profile as following.

And I also put let g:ycm_server_python_interpreter='/usr/bin/python' in my .vimrc. Then vim in CLI works fine as following, checked with :YcmDebugInfo.

But the macvim still cannot work as the first figure. Despite macvim can work after comment conda in bash_profile. However, I still need conda to work.
How to solve this problem of the disagreement with macvim and vim, in terms of YCM? Thans a lot!
My full configuration of vim can be found at https://znculee.github.io/blogs/tools/vim#configuration.

My full configuration of vim can be found at https://znculee.github.io/blogs/tools/vim#configuration.

is your MacVim built with Python 3.7? if yes, ViM (and MacVim as well) doesn't really well support it.

YCM uses python interpreter from PATH by default, enabling importing and checking from virtualenv.
Probably you should address this issue to YCM repo itself rather than to MacVim repo.

@eirnym Thank you for your reply. My macvim is installed with brew cask, which is a pre-compiled version. I open this issue in macvim repo because my vim in CLI, installed with brew, can work well in the same situation.

Hi Arseny,
Thanks for your reply! My MacVim is installed with brew cask, which is probably a pre-complied version, packed in a dmg file, therefore, I am not sure whether it is built with Python 3.7.
I have solve this issue in both  previous versions of MacVim and Vim of CLI, with let g:ycm_server_python_interpreter='/usr/bin/python’. But in the last MacVim version, this problem cannot be solved as I issued in GitHub.
Best,
Xintong

On 10 Jul 2018, at 06:39, Arseny Nasokin<EMAIL_ADDRESS>wrote:
is your MacVim built with Python 3.7? if yes, ViM (and MacVim as well) doesn't really well support it.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/macvim-dev/macvim/issues/709#issuecomment-403642346, or mute the thread https://github.com/notifications/unsubscribe-auth/AOoaVdAfBxjsnhyV2vKs2uzCqT03UEZ8ks5uE9uugaJpZM4VHran.

Does MacVim built with dynamic python2? If yes, could you directly specify which Python2 library to load?

@eirnym The MacVim is installed by brew cask, which is in a dmg file. That means I have not built it on my own. However, I found there is the same error when I use fish instead of bash. So maybe this is issue may belong to YCM. Thanks anyway.

@eirnym I fixed this problem by add let $PATH='$HOME/.cargo/bin:/usr/bin:/usr/local/bin:/bin:/usr/sbin:/sbin' in my .gvimrc.


More stories

I suggested some typo fixes. Because I like to support this project, and it's all I can think of as a way to contribute. I hope it's appreciated.

I suggested some typo fixes. Because I like to support this project, and it's all I can think of as a way to contribute. I hope it's appreciated.

Of course!! It's very much appreciated!

@joostholslag where can I find your suggestions? Did you create an issue? I can't seem to find it.

@joostholslag where can I find your suggestions? Did you create an issue? I can't seem to find it.

Can you see them now? https://github.com/sidharthramesh/medblocks-ui/pull/27#discussion_r632299948

@joostholslag where can I find your suggestions? Did you create an issue? I can't seem to find it.

Can you see them now? #27 (comment)

Thank you @joostholslag. I've applied your suggestions.


Update requirements.txt

Update requirements.txt

Hi thanks for the PR as the package is intended to be installed via pip etc we don't use a requirements.txt. You can install it remotely via pip install git+https://github.com/TCDSolar/xrayvision.git or if you cloned the repo locally pip install -e .[all]. (I need to check the exact syntax so if these don't work let us know)

@samaloney So should this PR be closed if we don't currently use requirements.txt?

Yea this can be closed I was just giving the author some time to respond to make sure they got sorted.


Iot Dashboard does not write the SD Card, no error

I tried at home to write and SD card with build 17763 for raspberry. The download was done but the SD card seems not updated, The IoT Dashboard shows still the old build 15xxx. I tried then another smaller 4GB sd card with no image on it, and here I could see that no write happened.
Is there any cause why this could happen without any error?
The 8GB with 15xxx image is a SanDisk EDGE 8GB HC I

@trivalik While I don't doubt the error you came across, I cannot reproduce this error as the dashboard offers the 17763 build. It's better to use a 16GB SD card if you can. It's possible that your SD card could not fit the recent build.

After looking for a cause it is maybe that drive C:\ was near full. Some software eaten up around 20 GB and I didn't got that., maybe the last VS2017 update.
I guess that the IoT Dashboard is installing the flash.ffu on C:\Program Files... and that file is not there, like when I manual install the msi file with the flash.ffu image.

That would make sense. If you clear the SD card and it still doesn't work, please feel free to create a new issue.


Fall damage

When you are in an air ship and touch the floor you take a massive amount of fall damage even if you descend to the ground slowly. This needs to be fixed as you can not really land the ships

are you riding the ship, as in sitting on it?

oh I think I get the error now, I thought I fixed that ages ago. I guess not

fixed this I think, reopen this issue if not


Fix issue: Command Palette is not callable in JupyterLab view

Description
Fixes: #954
Checklist

[x] The PR branch is set up to merge into dev instead of master.

the address bar gains focus and breaks something so I can't just close the command palette anymore

I'm afraid that's the browser built-in behavior (see Firefox for example). This is something we could not control. We could consider changing the key combination though.

@astrojuanlu  Could you try again with the new commit? And which browser are you using? I tested it on Chrome Firefox, Brave, all seem to work as expected.


Dynamically adding and removing crons problem

Hi there!
I'm facing a problem when adding and removing crons dynamically.
Apparently destroy works fine, but for some reason, when adding new crons after a first set of crons started (server loads crons from database and starts initial crons)
I get this error on the new crons:
TypeError: this.execution is not a function
at Promise (........./node_modules/node-cron/src/task.js:52:23)
Any idea?

Let's get the obvious out of the way.
When you call cron.schedule(time, function), you have verified your passing a function and not something else, like  string representing a function?

cron.schedule(cron.schedule, callback);
Yes, it's a function actually the first ones work.

Let's get the obvious out of the way, I'm stupid. xD
The second time, when dynamically I wasn't adding the callback
Sorry

You could add an issue to the git that the schedule function should throw if a required parameter like the callback is missing.


Terasology no longer compiles on eclipse

With #1740 merged, Terasology does no longer compile on eclipse. The following line fails:
assetTypeManager.registerCoreAssetType(BlockTile.class, BlockTile::new, "sounds");

The target type of this expression is not a well formed parameterized type due to bound(s) mismatch
I first thought that this was a bug in the eclipse compiler: Eclipse Bug 425278, but if I understood it correctly this is supposed to happen.
One of the compiler developers reported a bug for OpenJDK that javac compiles the code fine, but it shouldn't.

Huh! Now that's interesting.
I do find the :: a bit scary still, haven't taken the time to get used to it yet :D Java is getting complicated.

Three merged PRs later is this one resolved?

Yup - thanks!


Query __args that are Integer value are not converting into integer

Scenarios: lets say we got query like this:

{
users (first: 1000, where: {showInFrontend: true}) {  // first : 1000 is an integer value
edges {
node {
databaseId
}
}
}
}

the resulting argument object becomes:
args { first: '1000', where: { showInFrontend: true } } // this is incorrect as its meant to be IntValue
I did a modification to your code locally for now to fix it. The Fix:
In your getArguments and getArgumentObject function you also want to check the kind for IntValue like this eg in your getArguments function :
} else if (arg.value.kind === 'IntValue') {  argsObj[arg.name.value] = parseInt(arg.value.value); {
I can do a PR if you want. Also thanks saved me hours of work trying to convert to Json 👍

This is a great suggestion, thank you for this @BhupenT ! Could you open a pull request for it with an added unit test?
Do you know how the behaviour would be for other types, let's say floats - could you implement these number types as well? Would booleans work already?
Thank you!

Thanks for raising this issue @BhupenT 👍🏼
I agree with @rickschubert here! If you could raise a PR, that'd be great along with unit test coverage for your changes.
Great question @rickschubert, what will happen with floats and booleans etc

Sure thanks @rickschubert, I will do a PR sometime by tomorrow. Boolean works fine as selectionSet value must be true or false without quote. Haven’t tested with floats. We do need to support all the AST kinds if DocumentNode of that value is set as string type. Eg. value: ‘123.45’

@BhupenT I was wondering if you were still happy to take on this issue? We'd love to see a solution for it 🙏🏼 Let us know if there's anything we can do to assist 🤝

Hey @BhupenT, it's been a while since we heard from you.
Are you still interested in providing a PR to fix this issue?
We would love to support you in getting this fixed, if not - don't worry we can look into it 👍🏼

Hi @thomaschaplin and @rickschubert. Thanks a lot guys. Sorry that i am late to the party, been busy and had to quickly do things on some project which had to work on so din't had time. I also found few other features that may be a good idea to add here. I just forked and put it there which i can create a PR if this is something that may interest you guys.

Support for inline fragments ( using __on similar to how Json to gqlQuery does )
Support for alias based query (using __aliasFor similar to Json to gqlQuery does
So it can be used with the combination for JSON->Query and Query->Json

Here is the forked one which i just added a commit that i had implemented ages ago which i think its good to share it with you guys. Commit changes view here
Once again Thanks you all.

Hi @thomaschaplin and @rickschubert. Thanks a lot guys. Sorry that i am late to the party, been busy and had to quickly do things on some project which had to work on so din't had time. I also found few other features that may be a good idea to add here. I just forked and put it there which i can create a PR if this is something that may interest you guys.

Support for inline fragments ( using __on similar to how Json to gqlQuery does )
Support for alias based query (using __aliasFor similar to Json to gqlQuery does
So it can be used with the combination for JSON->Query and Query->Json

Here is the forked one which i just added a commit that i had implemented ages ago which i think its good to share it with you guys. Commit changes view here
Once again Thank you all.

Thanks @BhupenT - I've created an issue for this to be looked into. We may get in touch to discuss it with you further.
Thanks again

@BhupenT @thomaschaplin Hi, just checking if we are currently supporting inline fragments query to be converted to json? if not, can you please suggest how we can convert it using any other method?

@harmeetsingh17 Checked this open PR if it does what you need? https://github.com/trayio/graphql-query-to-json/pull/23


Installation Error

I am getting this error even though the environment variables are correctly set:

Hey @JPGranizo I'm also getting the same error. Have you got any solution?


Benchmark rewrite

The original benchmark implementation was a bit limited for my benchmarking purposes, so I've extended it.
This version will test different data lengths and speeds, and tries to do some basic stats to improve output.
It also supports targeting different word sizes (8/32/64bit), though only one at a time. This is not something I think is important to most people, and i know at least one target (esp32-c3) only supports 32bit reads/writes.
The whole thing definitely needs more error handling. It quits on most probe errors.
Oh, I also removed the http reporting since that isn't being used. Not bringing in reqwest should improve build times somewhat.

Thanks a lot! I am happy to merge this as is if you want to undraft :)
We can reiterate on robustness later on :)

I wanted to validate the statistics first + I think reqwest might have been added as a dep for something else in another commit. But happy to unmark as draft if you don't mind checking that

If our CI tests run green, I would assume dependencies are okay. If not, we have to fix the CI :)

I think this actually needs to be rebased :)


[New] AGPS Widget

Download A-GPS data to the Bangle2 automatically every 12 hours in the background

Thanks! Is it worth actually having the agpsdata app now? It feels like they are pretty much duplicates, just that the widget is a widget?

It's a question of once vs always. I still see a value in a separate app

Ok, it's just a bunch of code duplication.
You could just have one app that either allowed you to upload AGPS data once, or turn on the widget to upload it automatically


better instructions for linux download & install

Since the file doesn't down load with the executable bit set (apparently) it is potentially quite confusing for end-users to figure out how to get the installer (e.g. MCEdit.v<IP_ADDRESS>.Lin.Universal.run) to actually run. Since it looks like a shell script, doing ". ././MCEdit.v<IP_ADDRESS>.Lin.Universal.run" might seem plausible but gives a cryptic "./MCEdit.v<IP_ADDRESS>.Lin.Universal.run: cannot execute binary file" which doesn't turn up good results when googling around for answers to it. Turns out doing "chmod +x ./MCEdit.v<IP_ADDRESS>.Lin.Universal.run" and then "./MCEdit.v<IP_ADDRESS>.Lin.Universal.run" is the trick.

The execution bit is actually set on the autoextractible when building it, but is removed when downloading.
This is due to the download protocol.
On an other hand, letting executable files being loaded can be a security issue.
On Linux systems; it's up to the user to set (or not) the execution bit on a file.


1st Meeting with UM/NRI/CSIRO

Attendants, Alistair, Arnold, Clair, Joao, Roamin
Copy directly from ESMValTool, but mainly used for the meeting notes.
Note:
Here are the next steps that I noted:
•	Reconvene in a month.
•	Set up cross-partnership working group, via the next GC partners coordination group.
•	Alistair to share tutorial information
One other thing I should have mentioned was that there is an open zoom meeting of the community every month, usually organised by Bouwe Andela at the Netherlands eScience Center. It is attended by a mix of beginners and experts. To give you a flavour, the notes from the most recent one are here: https://github.com/ESMValGroup/Community/discussions/73
That page also includes a link to join the mailing list, so that you get invites to future meetings (and other news).
Here is a link to the community tutorial:
https://esmvalgroup.github.io/ESMValTool_Tutorial/index.html
This now includes a “quick start” guide (episode 2) that came out of the internal tutorial we developed at the Met Office. I will see how we can export the Met Office-specific tutorial so that you can see if there are aspects that you would like to mirror in time.

Follow-up setup env only for NRI-MED kj13/iq82
conda environment is here:
export MODULEPATH=$MODULEPATH:/g/data/kj13/environments
module load conda/esmvaltool_dev
The work in progress config file is in: /g/data/kj13/users/rb5533/esmvaltool_tutorial

setup for obs

discp in ~/.esmvaltool/config-developer.yml
  input_dir:
    default: 'Tier{tier}/{dataset}'
  input_file:
    default: '{project}_{dataset}_{type}_{version}_{mip}_{short_name}[_.]*nc'
discp in the recipe
dataset: ERA-Interim,  project: OBS6, mip: Amon, type: reanaly,  version: 1,  start_year: 1980,  end_year: 2000,  tier: 3
discpin real data
obsdata/Tier3/ERA-Interim/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_ts_199601-199612.nc


Add a convenience wrapper to the Rollout class

I like my variables with less $'s.
This adds a nice convenience wrapper so OTB, there's no need to $ if you're using a single Rollout instance...
I could also tweak if you like:
# As-is now, closer to original implementation
Rollout.setup do |rollout|
  rollout.storage = Redis.new
  rollout.options = {migrate: true, randomize_percentage: true, ...}
end

# But I could also make it like this:
Rollout.setup do |rollout|
  rollout.storage              = Redis.new
  rollout.migrate              = true
  rollout.randomize_percentage = true
  ...
end

Thoughts?

I'm not a fan of this because it makes it look like the intention is that there only is one rollout instance in a project, which isn't the only way to do things.
What does this really buy you? If you don't like using globals, you can create your own object that does this. It doesn't need to be called ::Rollout.


RaffoSynth's moog and LibraZiK-2

Hi @nicoroulet ,
I'm usually sending an email to the upstream developer for that but I can't find one for you. Hence this "issue".
Just to let you know that, as of today, RaffoSynth's moog 0.0.0~git7d267a0 has hit the LibraZiK-2's users repo.
Thanks for this nice moog-ish software!
PS: feel free to close this "issue" when you have read it.

Hey there, @trebmuh!
I am a co-developer of RaffoSynth moog with my dear friend @nicoroulet, and I didn't want to miss this chance to thank you, @jofemodo and @jpcima for your interest in our synth and for adding it to LibraZiK-2.
We will try Librazik as well to check out your whole project! Cheers

Hi @julianpalladino and thanks for your nice words. I hope you'll like the LibraZiK-2 experience, let me know how it goes.
(Note: you can try it without installation thanks to the USB live ISO provided)


Allow hosts to create their own question sets

Nearly done then received this error Module parse failed: Unexpected token | You may need an appropriate loader to handle this file type. No luck after trouble shooting for an hour so switching issues for now.

https://github.com/hto-projects/friendpardy/pull/249/


Add test highlighting key rotation challenges

This added test fails. See issue #503 for discussion.

Thanks for the test demonstrating the issue!


Parse login json POST request

Similar to parsing out the json create user message.  Also part of this ticket, validate that the fields are in the correct format.

See the create user portion as a template to complete.

Taking this one as well.

Hitting a wall with a logging issue in the codebase


perlPackages.Appcpm: 0.996 -> 0.997000

Motivation for this change
https://metacpan.org/release/SKAJI/App-cpm-0.997000
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[X] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[X] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[X] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[X] Fits CONTRIBUTING.md.

Thanks! :tada:

Thanks! :tada:


Reorganize the custom scripts

Right now the custom scripts are located in the root directory, which is not ideal. We need to move them in a folder, so it is clear which one is the custom script.

Successfully reorganized. Moved:

configs to conf/
system wrapper to system/
additional scripts to bin/
Modified/tested Dockerfile


actual_appt_footprint of HSI_Tb_Xray_level2 in conflict with mode_appt_constraints = 2

In HSI_Tb_Xray_level2, if consumables are not available the HSI defaults to a clinical diagnosis, with adds another clinical appt footprint ("Under5OPD" : 1) to the expected one. Under5OPD relies on different medical officers than the expected_appt_footprint ("DiagRadio": 1);  an issue in mode_appt_constraints = 2 therefore occurs when capabilities for the officers required for the Under5OPD have already been exhausted before the HSI is ran, since we cannot know that those officers would be required until the HSI is actually ran. This is what leads to issue #1089.
There are two possible solutions:

Since this seems to be quite an infrequent occurrence (~3 times a month in a 50,000 population according to analysis in #1089, although this would depend on prioritisation policy) we could ignore the exhausted capabilities issue for the particular instance of the Under5OPD appt for this HSI.
For the specific case of HSI_Tb_Xray_level2, when checking if capabilities are still available we can, in addition to capabilities required for the expected_footprint, check whether there are also capabilities for an Under5OPD appt, whether those would actually be required when running the event or not.
Modify the HSI s.t. instead of simply adding the Under5OPD footprint, an additional clinical HSI is scheduled.

@tdm32, what would you recommend?

Hi @marghe-molaro, thanks for flagging this.
I suppose if the consumables are not available for xray we should amend the footprint to be blank as the DiagRadio appt will not occur. I think what would likely happen is that they are referred back for a clinical diagnosis which would require another under5OPD. We might need to write a separate clinical HSI for this though as we don't need them to go through the whole triage process plus HIV testing in HSI_Tb_ScreeningAndRefer. It could even be a 0.5 Under5OPD appt with a pharmacy appt attached.
I can do this as a separate PR if helpful?

Hi @tdm32, I think a separate clinical HSI would fix this issue quite nicely, as it would require no "compromise" with the mode_appt_constraints assumptions (since we can check that all required officers are available to perform this clinical HSI before it is actually ran). A separate PR would be perfect, thank you!

@marghe-molaro I'm on it :-)
Just a note to add the priority ranking for the new treatment id - if you're happy to do that. I don't want to mess with your system.

Thank you so much @tdm32! We've actually added a new "safety feature" which checks that all Treatment_IDs are included in the policies before PRs can be submitted, so when you add the new treatment id you should - hopefully! - see the test_all_treatment_ids_defined_in_priority_policies test failing. But if you submit the PR anyway I will make sure to modify the policies accordingly and resolve that error. Check I just check with you - I guess the priority we would assign to the new HSI should be the same as the original one?

@marghe-molaro Yes keep the same priority for this, it's just another step in the TB diagnostic triage. Thanks Margherita!


BootstrapFewShot with max_rounds > 1 fails

I started my dspy journey  with the 2.5.3 version. Following the quickstart example I created a llm instance
dspy.OpenAI(...)

However this approach seems to be deprecated, so now I use
dspy.LM(...)

I was using the BootstrapFewShot for a while. It worked until I increased to max_round param to 2, from the default 1.
The error is
  File "/home/kpob/workspace/python/dspy-test/lib/python3.10/site-packages/dspy/teleprompt/bootstrap.py", line 182, in _bootstrap_one_example
    lm = lm.copy(temperature=0.7 + 0.001 * round_idx) if round_idx > 0 else lm
AttributeError: 'LM' object has no attribute 'copy'

My issue is similar to https://github.com/stanfordnlp/dspy/issues/1391. Yet I do not implement my custom LM, but just passing a model as a teacher.
 def __init__(self, metric, lm: dspy.LM, program, program_name: str, metric_threshold=1.0):
        self.lm = lm
        self.metric = metric
        self.metric_threshold = metric_threshold
        self.program_name = program_name
        self.program = program

def __call__(self, trainset, record=True, experiment=""):
    optimizer = dspy.BootstrapFewShot(
            metric=self.metric,
            metric_threshold=self.metric_threshold,
            max_labeled_demos=2,
            max_rounds=3,
            teacher_settings=dict(lm=self.lm)
    )

Hey, thanks @kpob for the catch. This is a new bug and I'll fix it today if I can.

@okhat @kpob I has same issue, I fix the bug #1621

Thanks @xiayouran ! Left some comments on the PR.

Fixed in 2.5.12


Fix Circular Dependency Outputs bug

A reference in an Output using !Sub to a Resource with the same name as the Output is seen as a circular dependency:
E3004 Circular Dependencies for resource ElasticIP.  Circular dependency with [ElasticIP]
test/templates/good/generic.yaml:113:3

Added a check on a Resource type, just like in the Ref and Fn::GetAtt part.
Added this scenario to the good/generic.yaml template for the tests
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Yikes.  Good catch


zoomOnPinch works very very slow on Windows machines

What platform were you using when you found the bug?

React Flow: 11.11.4
Browser and version: Chrome Version 125.0.6422.113 (Official Build) (arm64)
OS and version: reproduced in Windows 11 in Parallels on Mac OS 14.4.1

Live code example
No response
Describe the Bug
When zoomOnPinch=true on Windows machines, zoom on pinch works really slow, compared to the Mac machines.
Steps to reproduce the bug or issue
Open https://reactflow.dev/examples/overview on Windows machine and try to pinch zoom
Expected behavior
Zooming has the same speed as on Mac machine
Screenshots or Videos
No response
Additional context
There was related issue https://github.com/xyflow/xyflow/issues/3759, and looks like the function, that defines speed of zooming (wheelDelta ),  should be fixed

Same issue here! +1


pyside2 5.12.1 win: wrong SHIBOKEN_SHARED_LIBRARY_DIR

in /Library/lib/cmake/Shiboken2-5.13.1/Shiboken2Config.cp37-win_amd64.cmake
set_and_check(SHIBOKEN_SHARED_LIBRARY_DIR "${PACKAGE_PREFIX_DIR}/bin")

should be:
set_and_check(SHIBOKEN_SHARED_LIBRARY_DIR "${PACKAGE_PREFIX_DIR}/Library/lib")

Edit: we are now using library dir via imported target properties.: https://github.com/FreeCAD/FreeCAD/blob/master/cMake/FreeCAD_Helpers/SetupShibokenAndPyside.cmake#L49

btw.: the configuration file doesn't look very good:
#----------------------------------------------------------------
# Generated CMake target import file for configuration "Release".
#----------------------------------------------------------------

# Commands may need to know the format version.
set(CMAKE_IMPORT_FILE_VERSION 1)

# Import target "Shiboken2::libshiboken" for configuration "Release"
set_property(TARGET Shiboken2::libshiboken APPEND PROPERTY IMPORTED_CONFIGURATIONS RELEASE)
set_target_properties(Shiboken2::libshiboken PROPERTIES
  IMPORTED_IMPLIB_RELEASE "D:/bld/pyside2_1569322331212/_h_env/Library/lib/shiboken2.cp37-win_amd64.lib"
  IMPORTED_LOCATION_RELEASE "${_IMPORT_PREFIX}/bin/shiboken2.cp37-win_amd64.dll"
  )

list(APPEND _IMPORT_CHECK_TARGETS Shiboken2::libshiboken )
list(APPEND _IMPORT_CHECK_FILES_FOR_Shiboken2::libshiboken "D:/bld/pyside2_1569322331212/_h_env/Library/lib/shiboken2.cp37-win_amd64.lib" "${_IMPORT_PREFIX}/bin/shiboken2.cp37-win_amd64.dll" )

# Import target "Shiboken2::shiboken2" for configuration "Release"
set_property(TARGET Shiboken2::shiboken2 APPEND PROPERTY IMPORTED_CONFIGURATIONS RELEASE)
set_target_properties(Shiboken2::shiboken2 PROPERTIES
  IMPORTED_LOCATION_RELEASE "${_IMPORT_PREFIX}/bin/shiboken2.exe"
  )

list(APPEND _IMPORT_CHECK_TARGETS Shiboken2::shiboken2 )
list(APPEND _IMPORT_CHECK_FILES_FOR_Shiboken2::shiboken2 "${_IMPORT_PREFIX}/bin/shiboken2.exe" )

# Commands beyond this point should not need to know the version.
set(CMAKE_IMPORT_FILE_VERSION)

looks like an upstream issue, please open an issue on their jira

@looooo I think there is no bug ihmo SHIBOKEN_SHARED_LIBRARY_DIR is intended to contain the path to runtime library (.so/.dylib/.dll); see pyside2/tests/CMakeLists.txt:12:        set(TEST_LIBRARY_PATH   "${libpyside_BINARY_DIR};${pysidetest_BINARY_DIR};${SHIBOKEN_SHARED_LIBRARY_DIR};$ENV{PATH}")
and on windows the runtime library .dll is indeed located in prefix/bin

Ah I see, so the real problem is linking to the runtime-library. This is the output if I try to do so:
[2340/3244] Linking CXX shared library bin\FreeCADGui.dll
.....
%PREFIX%\Library\bin\shiboken2.cp37-win_amd64.dll : fatal error LNK1107: invalid or corrupt file: cannot read at 0x348

Try to lin to the one of the provided targets Shiboken2::shiboken2 or Shiboken2::libshiboken

I think we are already doing so:
https://github.com/FreeCAD/FreeCAD/blob/3939e4543ef4be6c50581d9bff77e930fb1d9d03/cMake/FreeCAD_Helpers/SetupShibokenAndPyside.cmake#L49
get_property(SHIBOKEN_LIBRARY TARGET Shiboken2::libshiboken PROPERTY IMPORTED_LOCATION_RELEASE)
It works on linux and osx but results in the error reported above for win: https://github.com/conda-forge/pyside2-feedstock/issues/43#issuecomment-541759200

you want IMPORTED_IMPLIB instead of IMPORTED_LOCATION
but its simpler not to use the location, just link directly to Shiboken2::libshiboken

thx, I will check in the next iteration.

hmm, didn't work out of the box. I now see undefined references to shiboken funtions (windows, linux). Osx seems to work with your suggestion. Does it make any sense to use IMPORTED_IMPLIB_RELEASE insead of IMPORTED_IMPLIB?

thanks. Using the imported target indeed works.


fix: Automatic user logout with ClientSocketException when network is unavailable

Description
When the application is launched without a network connection, users are automatically logged out due to a ClientSocketException thrown in the _loadCachedTokens method.
Steps To Reproduce

Ensure the user is logged in with valid tokens stored in cache.
Disconnect the device from any network.
Close the app and launch it again (flutter restart).
The user is now disconnected after a ClientSocketException in _loadCachedTokens that call :

await store.removeMany(
        OidcStoreNamespace.secureTokens,
        keys: usedKeys,
      );

Expected Behavior

The app should attempt to load the cached tokens without requiring a network connection. If the tokens are valid and not expired, the user should remain logged in, or the app should handle the situation gracefully if tokens need refreshing but no network is available.

same problem with the init function. If no network, the discovery failed.

when not login in, the init function must call if no network on first attempt and failed to initialize before any login.

Actual Behavior

The application throws a ClientSocketException and logs out the user when attempting to load cached tokens without a network connection.
when not login in, the init function  failed if no network, when network is ok and the login failed too.

Possible Solution Suggestion
It would be beneficial to implement a check to see if the network is available before attempting operations that require a connection. Additionally, the token loading mechanism could handle exceptions more gracefully, perhaps by using cached tokens if they are still valid and postponing token refresh until a network connection is reestablished. Same for the init call.
Best regards,
Alexandre

I agree this is a problem especially for offline-first apps (desktop mainly), let me see what I can do 👍

hi @heralight , I have studied this issue in the past couple of days, and here is the result of my research:
The issue here is a matter of convenience vs security.

Support offline auth (convenient)

The developer MUST opt into this behavior as it will have security concerns.
Handle token validation
a. The jose_plus package MUST be able to serialize and deserialize a resolved JsonWebKeyStore.
b. OR enforce strictJwtVerification = false when offline support is desired.
the app MUST allow expired access/id tokens to remain when refreshing has failed

Don't support offline auth (secure) (default)

User tokens will be removed if they can't be verified or refreshed.

to support offline auth, a new setting can be introduced in OidcUserManagerSettings (e.g. OidcUserManagerSettings.supportOfflineAuth) that's mutually exclusive with strictJwtVerification until we are able to cache JWK stores.

Update:
I have introduced offline support in pr #89 with support to caching JWKs

@ahmednfwela thank you for your feedback and work,
as you said it's a matter between conveniency and security. But as it was, the plugin was nearly unusable due to this auto disconnection.
ideally, in secure mode, the disconnection must only appears when the refresh AND and have internet, not on network error.
After that, the insecure mode has very low risk, due to the fact, that the token will reject by the server...
I will upgrade to your new version and test supportOfflineAuth.
best regards,
Alexandre


Some new thoughts on cutting a release, especially scripts/release.sh

Why are these changes needed?
We need to automate the process of version management and release cutting.  This is just a start with some initial thoughts based on recent discussion.  Initial changes include

Change .make.versions to define a common repo-wide version for all libraries and images.
Add scripts/release.sh which tries to outline the steps needed to changes versions, create and tag a branch.
Makefile new target to show-version based on .make.versions content

Relies on make build publish being enough to actually publish the release to pypi and quay.io
Also see PR #297
Related issue number (if any).
#294

@daw3rd please do not do the release automation before we agree on the process. Some of the functionality can be done by GitHub actions

@daw3rd please do not do the release automation before we agree on the process. Some of the functionality can be done by GitHub actions

I didn't think I was, except that I added the make tests for the test, clean, publish, build, set-versions top-level rules and some Makefiles needed to implement these

We should deploy 2 kfp-data-processing images one for KFPv1 and another for KFPv2. Will try to update the script to proceed with that.


TagBot trigger issue

This issue is used to trigger TagBot; feel free to unsubscribe.
If you haven't already, you should update your TagBot.yml to include issue comment triggers.
Please see this post on Discourse for instructions and more details.
If you'd like for me to do this for you, comment TagBot fix on this issue.
I'll open a PR within a few hours, please be patient!

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/105704

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/105864

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/110897


gv.Shape fails with KeyError

I just updated to the new holoviews and the following example from the geoviews docs is now broken:
import geoviews as gv
gv.extension('bokeh')
import cartopy.crs as ccrs

land_geoms = list(gv.feature.land.data.geometries())
australia = gv.Shape(land_geoms[21], crs=ccrs.PlateCarree())
australia

complaining about KeyError: Longitude.
Precision: On current master, installed with pip, it works:
geoviews                  1.6.3a10                 pypi_0    pypi
holoviews                 1.12.4                     py_0    conda-forge

Whereas the released versions don't:
geoviews                  1.6.2                      py_0    conda-forge
geoviews-core             1.6.2                      py_0    conda-forge
holoviews                 1.12.4                     py_0    conda-forge

Feel free to close unless you think there's something worth investigating further.

There will be a 1.6.3 release later today fixing this.

Great, I'll close this then.


Failed to parse DD_VERSION with integer value after upgrade

I recently upgraded to v67 from v63 and now I'm getting pretty frequent warnings in logs for my Lambda functions. I am setting the version env variable to an integer value that represents the build number, using the DataDog CDK construct. After the upgrade, my functions are logging the following output:

Failed to parse Datadog config: invalid type: found unsigned int 298, expected a string for key "VERSION" in DD_ environment variable(s)

These are INFO level logs, but I'm concerned that this may negatively impact our ability to tie a Trace back to a specific deployment and it creates a lot of noise.

Thanks for reporting this @CodyDunlap !
A fix will be released with v68, meanwhile, a workaround could be to use a string as tag, setting the DD_VERSION="123"

I'm not sure the workaround would actually work, though. I attempted this to a degree. As far as I'm aware, Lambda doesn't treat DD_VERSION="123" and differently than DD_VERSION=123. It seems the issue is that if Lambda can read the env variable as an integer it will. I haven't tried it yet, but my assumption is that if I set the version to something like DD_VERSION=1.0.123, then Lambda would treat that as a string because it cannot be parsed as an int.

I added DD_VERSION env variable as "123" (with those ") and it seems to be working!
The PR with the fix meanwhile is https://github.com/DataDog/datadog-lambda-extension/pull/492/files

Ahh. I'm doing this from the AWS CDK, so I'll try escaping the quotes and see if that does it. Thanks!


CDSSM output layer for classification

In CDSSM model implementation, it first calculate cosine similarity with Dot, which is a scalar, then it feeds the scalar to Dense with output size=2 and activation type being "softmax". This is really weird. How could one product a softmax for binary classification from a single scalar? Did I miss something here?

check out section 4, this paper:

Following [20], we first convert the semantic relevance score between a query and a positive document to the posterior probability of that document given the query through softmax..

Thanks. Yes. I am referring to task type=classification. I read the referred paragraph in the paper. To create the SoftMax, there needs to be some negative documents. (to simulate the capitable D in the paper).  Where shall I supply these negative documents in the current cdssm implementation?

@hexiang129 It's not implemented in the current version of MatchZoo, but it will be there in MatchZoo 2.0.
Take a look our new PairGenerator

I see. thank you!