I find gctoolkit can't parse a CMF my gc log

I find gctoolkit can't parse my gc log and show that
Missed: 2021-12-19T22:31:54.909+0800: 623.525: [Full GC (Allocation Failure) 2021-12-19T22:31:54.909+0800: 623.525: [CMS (concurrent mode failure): 2097152K->2097152K(2097152K), 9.4110998 secs] 3984639K->3984638K(3984640K), [Metaspace: 215219K->215219K(1241088K)], 9.4112098 secs] [Times: user=9.27 sys=0.15, real=9.41 secs]
I think gctoolkit should add or modify a rule to match the line of gc log.
By the way, I suggest we should build an issue to record the missing rule which used to strengthen gctoolkit.
Originally posted by @ZhangShushu123 in https://github.com/microsoft/gctoolkit/discussions/192

@ZhangShushu123 - Would you be willing to try and adjust the pattern?  I'd love to see what we're missing in terms of helping contributors make changes like that :-)

Ok, I will follow this issue and try my best to contribute it :-)

I find this pattern [CMS (concurrent mode failure): 2097152K->2097152K(2097152K), 9.4110998 secs] 3984639K->3984638K(3984640K), [Metaspace: 215219K->215219K(1241088K)], 9.4112098 secs] [Times: user=9.27 sys=0.15, real=9.41 secs] also appear in promotion failed line.

I think the solution of this issue is changing the CMS_TENURED_BLOCK from
DATE_TIMESTAMP + "\\[CMS: " + BEFORE_AFTER_CONFIGURED_PAUSE + "\\]" to
DATE_TIMESTAMP + "\\[CMS(?:| \(concurrent mode failure\)): " + BEFORE_AFTER_CONFIGURED_PAUSE + "\\]"

@kirk-microsoft - WDYT?

Ok, this is weird. I was following this thread and I didn’t see any new comments show up until now.
This might work however, and unfortunately, without properly functional named capture groups, the parsers rely capture group indexes which is very fragile. Since this rule fragment is used in many different places, one needs to be careful as to not disturb the indexing. This is also an area that deserves better test coverage. That said, you’ll end up breaking a test some where when this happens. Second issue is in the interpretation of the data. This is a full GC inside a concurrent cycle. Is it in or out of a concurrent phase. It would appear to not be. Anyways, the Point is, we need to present the event so that any interested downstream aggregators will have a chance at understanding what has happened so they can capture and report on this issue.

Ok, this is weird. I was following this thread and I didn’t see any new comments show up until now. This might work however, and unfortunately, without properly functional named capture groups, the parsers rely capture group indexes which is very fragile. Since this rule fragment is used in many different places, one needs to be careful as to not disturb the indexing. This is also an area that deserves better test coverage. That said, you’ll end up breaking a test some where when this happens. Second issue is in the interpretation of the data. This is a full GC inside a concurrent cycle. Is it in or out of a concurrent phase. It would appear to not be. Anyways, the Point is, we need to present the event so that any interested downstream aggregators will have a chance at understanding what has happened so they can capture and report on this issue.

What's the proposed next step here do you think?  We wait until we have named capture groups before fixing this one?

I was trying to clarify the issues without being prescriptive. That said, I’m happy to eval a PR with this solution.

I have the same problem and expect it to be solved


Tabline should not set window_decorations options

https://github.com/michaelbrusegard/tabline.wez/blob/7ca0479c06284db77ab826805063f3c71a8b20e2/plugin/init.lua#L52C9-L52C11
Title. Plugins should not silently manage and override unrelated user configuration.

While I agree with what you are saying, as outlined in the documentation, calling the apply_to_config method is completely optional. The settings set there is for a quicksetup if you dont want it you can set the options you want manually which is what I am doing in my config

I will close this because of no response


WIP: design notes for future improvements.

Just a collection of comments that could be potential issues/PRs in the future.

In dipstick, AtomicBucket is sort of an all-in-one receiver/sender object, and can be cloned and act as receiver or sender.
This actually ends up being pretty fast but it does a lot of work upfront, and I think we could capitalize on a hybrid approach!

Despite being an Arc around a function pointer, this basically means everything can update the metrics directly, so no channel required and no dedicated receiver thread required.  The tail latencies are honestly pretty great since there's no event loop to stall.
I'm not entirely sure we want a RW lock in the critical path of pushing a metric: even if we cached the object for each metric within the sink on the first hit for it, we're still touching a RW lock.
Since we'd no longer have an event loop, we would have snapshots with metrics that were slightly out-of-sync i.e. we could measure a single metric and then hundreds of micros later, finally collect the last metric into our snapshot.  Probably not a big deal, but worth mentioning.
The other problem is that for our current histogram storage, we do periodic upkeep.  With no event loop, we'd have to amortize that work inline, which could murder the tail latency for histogram ingest.  Technically that can still happen now and would stall the entire loop and not just ingest calls, but also worth mentioning.  We would also need an atomic way to add a value to a list while dealing with unknown capacity requirements.  We could maybe use crossbeam's SegQueue since it handles pushes but it has no good way to iterate en masse or clone it.
On top of all of that, we'd need storage to hold the list of metrics, the metrics registry, that is, for actually having the list of metrics to snapshot.  We might just want CHashMap (concurrent hashmap)
All in all, we would at least need:

a type to provide atomic update access to a given metric
internal concurrent storage for metric types to create new metrics / grab them
an atomically-updatable list that can be cloned atomically

Chatting with @stjepang about this:

we could likely use im::Vector and arc_swap for the histogram storage (eventually-consistent vector push + snapshotting through clone + iteration)
evmap is probably the answer for the metrics registry but it's single-writer

We would need a lock around the write side -- which is bad because it gets touched for every new metric (or metric/labels pair if we add labels support) -- and it doesn't have the entry API but we'd already have a lock so we could probably get away with also using it there to give us the entry API behavior.
With that said, I think our API could look something like...
#[derive(Eq, Hash, Clone)]
struct MetricName;

#[derive(Eq, Hash, Clone)]
struct MetricLabels;

#[derive(Eq, Hash, Clone)
enum MetricIdentifier {
    Unlabeled(MetricName),
    Labeled(MetricName, MetricLabels),
}

enum MetricKind {
    Counter,
    Gauge,
    Histogram,
}

#[derive(Clone)]
struct MetricValue;
impl MetricValue {
    pub fn update(&self, value: i64);
}

struct MetricRegistry {
    metrics: evmap::WriteHandle<MetricIdentifier, MetricValue, _, _>,
}

impl MetricRegistry {
    pub fn get_metric_value(&self, name: MetricIdentifier, kind: MetricKind) -> MetricValue;
}

We'd store a global registry of metrics -- HashMap<MetricIdentifier, MetricValue> but with evmap -- and Sink, when updating a metric, would clone the MetricValue handle it got back, so we'd only ever touch the global registry on the first time a Sink interacted with a particular metric identifier, and then use a locally cached handle for future updates.  This could still be slow enough for high RPS workloads where a metric is only touched once per request and can't easily be cached, but we might be able to share the evmap::ReadHandle for fast unlocked reads of the registry when a metric already exists.
The value handle would provide atomic updating: for counters/gauges, we'd use pure atomics, while for histograms, we'd use the aforementioned eventually-consistent vector approach.  For histograms, we'd also need a mechanism to perform upkeep but I think it's doable with some low-overhead tracking of when a caller might be recruited into volunteering its time to do the work.
Random thoughts:

this API uses i64 for the simplicity of design, but could we easily provide i64 and u64 versions without a ton of duplication/separate codepaths?
is it possible to have im::Vector keep its storage around? truncate looks like more drain and since we're only storing integers, we don't care about dropping them
even if we could keep around the storage, could we devise an algorithm to eventually shrink down the vectors when idle to reclaim memory?

Gonna close this as it's been realized with #13.


Handle undeliverable emails

Is your feature request related to a problem? Please describe.
Currently the email integration is sending an email in fire and forget mode.
If the email adress is wrong or other reasons occur that prevent email reception by the recipient, no error handling is done.
Describe the solution you'd like
If an undeliverable response occur, an appropriate error message has to be returned via kafka.
Describe alternatives you've considered
n/a
Additional context
n/a

Problem is already addressed in https://app.zenhub.com/workspaces/digiwf-621f70bf50ea1100120b7e93/issues/it-at-m/digiwf-project/107


Improve UTF-8 handling

Improves correctness of UTF-8 handling, as well as performance improvements to utf-8 iterator
(https://gist.github.com/skejeton/bbd9259732bcbcc091ba0cd46712a08a), as tested on my machine

the PR seems to contain commits from old PRs
please remove the noet comment


How to fix the RuntimeError: cuDNN error: CUDNN_STATUS_NOT_INITIALIZED ? Thank you!

INTERFACE:
config yaml:  config/cityscapes/darknet21_aspp.yaml
log dir /home/pc/logs/2019-8-20-16:13/
model path None
eval only False
No batchnorm False
----------

Commit hash (training version):  b'5368eed'
----------

Opening config file config/cityscapes/darknet21_aspp.yaml
No pretrained directory found.
Copying files to /home/pc/logs/2019-8-20-16:13/ for further reference.
WARNING: Logging before flag parsing goes to stderr.
W0820 16:13:16.396194<PHONE_NUMBER>87200 deprecation_wrapper.py:119] From ../../common/logger.py:16: The name tf.summary.FileWriter is deprecated. Please use tf.compat.v1.summary.FileWriter instead.

Images from:  /home3/data/city/city_selected/leftImg8bit/train
Labels from:  /home3/data/city/city_selected/gtFine/train
Inference batch size:  1
Images from:  /home3/data/city/city_selected/leftImg8bit/val
Labels from:  /home3/data/city/city_selected/gtFine/val
Original OS:  32
New OS:  8
Strides:  [2, 2, 2, 1, 1]
Dilations:  [1, 1, 1, 2, 4]
Trying to get backbone weights online from Bonnetal server.
Using pretrained weights from bonnetal server for backbone
[Decoder] os:  4 in:  128 skip: 128 out:  128
[Decoder] os:  2 in:  128 skip: 64 out:  64
[Decoder] os:  1 in:  64 skip: 32 out:  32
Using normalized weights as bias for head.
No path to pretrained, using bonnetal Imagenet backbone weights and random decoder.
Total number of parameters:  19239412
Total number of parameters requires_grad:  19239412
Param encoder  14920544
Param decoder  4318208
Param head  660
Training in device:  cuda
Ignoring class  19  in IoU evaluation
[IOU EVAL] IGNORE:  tensor([19])
[IOU EVAL] INCLUDE:  tensor([ 0,  1,  2,  3,  4,  5,  6,  7,  8,  9, 10, 11, 12, 13, 14, 15, 16, 17,
        18])
/pytorch/aten/src/THCUNN/SpatialClassNLLCriterion.cu:103: void cunn_SpatialClassNLLCriterion_updateOutput_kernel(T *, T *, T *, long *, T *, int, int, int, int, int, long) [with T = float, AccumT = float]: block: [3,0,0], thread: [576,0,0] Assertion `t >= 0 && t < n_classes` failed.
/pytorch/aten/src/THCUNN/SpatialClassNLLCriterion.cu:103: void cunn_SpatialClassNLLCriterion_updateOutput_kernel(T *, T *, T *, long *, T *, int, int, int, int, int, long) [with T = float, AccumT = float]: block: [2,0,0], thread: [352,0,0] Assertion `t >= 0 && t < n_classes` failed.
/pytorch/aten/src/THCUNN/SpatialClassNLLCriterion.cu:103: void cunn_SpatialClassNLLCriterion_updateOutput_kernel(T *, T *, T *, long *, T *, int, int, int, int, int, long) [with T = float, AccumT = float]: block: [2,0,0], thread: [353,0,0] Assertion `t >= 0 && t < n_classes` failed.
/pytorch/aten/src/THCUNN/SpatialClassNLLCriterion.cu:103: void cunn_SpatialClassNLLCriterion_updateOutput_kernel(T *, T *, T *, long *, T *, int, int, int, int, int, long) [with T = float, AccumT = float]: block: [2,0,0], thread: [354,0,0] Assertion `t >= 0 && t < n_classes` failed.
/pytorch/aten/src/THCUNN/SpatialClassNLLCriterion.cu:103: void cunn_SpatialClassNLLCriterion_updateOutput_kernel(T *, T *, T *, long *, T *, int, int, int, int, int, long) [with T = float, AccumT = float]: block: [2,0,0], thread: [355,0,0] Assertion `t >= 0 && t < n_classes` failed.
Traceback (most recent call last):
  File "train.py", line 117, in <module>
    trainer.train()
  File "../../tasks/segmentation/modules/trainer.py", line 302, in train
    scheduler=self.scheduler)
  File "../../tasks/segmentation/modules/trainer.py", line 487, in train_epoch
    loss.backward()
  File "/usr/local/lib/python3.5/dist-packages/torch/tensor.py", line 107, in backward
    torch.autograd.backward(self, gradient, retain_graph, create_graph)
  File "/usr/local/lib/python3.5/dist-packages/torch/autograd/__init__.py", line 93, in backward
    allow_unreachable=True)  # allow_unreachable flag
RuntimeError: cuDNN error: CUDNN_STATUS_NOT_INITIALIZED

Hi,
I updated your comment to make it easier to read.
The error message is because your labels are out of range. The cityscapes data needs to be preprocessed before use, to put all labels in the 0-19 range, using their api, which you can access here. The definition of the mapping for each label is defined by the user, and can be found on this script of their api. I usually replace the trainIds 255 and -1 by 19 to make a consistent cross-entropy-able label set.

I got it, sincere thanks for you quick reply!
Jack

@tano297

@tano297 I did want to train the segmentation model with my custom dataset (only 1 class foreground and background), but I don't know what to do ,so I use the cityscaple at first to have a try.
I wonder what should I modify the train.py to make it work? Thank you a lot!
Jack

If you want to check out a dataset that already does a foreground vs background sort of segmentation, I suggest you have a look at the people segmentation model. No modifications should be necessary for the train.py file, all you may need to do is to modify its parser to make the __getitem__ function access your data in the proper way, and the corresponding configuration file

It is my own datasets which I have annotated already. In which (0,255,0,64) stands for foreground, and (0,0,0,0) stands for background.
I will have a try now, thank you for your help!
Jack

Then your __getitem__ function should know how to open these images and labels, and use some numpy magic to get from color images containing (0,0,0,0) or (0,255,0,64) to monochrome images that contain 0 or 1, so that the loss function can be evaluated

@tano297 Thanks for your team's great work! I wonder what is the schedule for detection, instance segmentation part?

Thank you for the thanks :) It requires quite some work to maintain all the repos in our group, and most of the time it goes unacknowledged.
Detection is currently being worked on, so probably in october/november we will have some fast models that are easy to train, which is the whole point of the framework. We're not going for state of the art, but rather for well-tested archs, that provide robust results, and are easy to train and fast to infer.
In terms of instance segmentation, there is currently not a "standard" way to do it, so we are trying to figure out what is the best architecture we can come up with that makes inference fast for robotics, easy to maintain code, and still with good accuracy. We have some work on panoptic segmentation coming, so I think that this is the code that will be released, rather than our ICRA2019 paper, which is accurate, but not easy to implement and maintain in the long terms (too many components and too architecture/dataset dependent)

@tano297 I got it, waiting for them patiently! Bonnet frameworks including tf-based and pytorch-based are really awesome!

@tano297 Sorry to trouble you!  I have tried again and again and the error still appears
RuntimeError: cuDNN error: CUDNN_STATUS_NOT_INITIALIZED
I have attached the cfg and sample images in the mail to<EMAIL_ADDRESS>Could you help me out ? I'm not sure is there a problem to my environment. Thanks!
Jack

Hi,
If you load that data, and you tap into the parser, inserting print(np.unique(np.array(label))), which gives you the unique values included in the label you get [  0 255]. This should be [0 1]. This is because your image contains 0 and 255 rather than 0 and 1 in the png label.
If I add label = (np.array(label) > 0).astype(np.int) right before calling tensorize_lbl (for example, in line 134), then it works. I was able to make it train with this data you sent.
If this works for you, feel free to close this issue.

@tano297  It really works. Sincere thanks!

Glad to hear that. I'd like to thank you for sending me that data the and cfg file the way you did. It took me 2 minutes to reproduce the error and find how to help you. If more people did it like that, maintaining these packages would be significantly easier

@tano297 Very nice to help me to solve the problem. If new problem appears I will send the sample data and cfg later to save your time.
Thanks,
Jack

@tano297 @newforrestgump001 I am finding the same error but do not seem to be able to solve it. I have changes the labels and preprocessed the label file (changed labels.py and ran python createTrainIdLabelImgs.py ) but  the code still exits before completing
File ../../tasks/segmentation/modules/trainer.py, line 488, in train_epoch     loss.backward()
Do you have any idea what I could do to solve this issue?
My labels.py file in cityscapes:

labels = [
    #       name                     id    trainId   category            catId     hasInstances   ignoreInEval   color
    Label(  'unlabeled'            ,  0 ,      19 , 'void'            , 0       , False        , True         , (  0,  0,  0) ),
    Label(  'ego vehicle'          ,  1 ,      19 , 'void'            , 0       , False        , True         , (  0,  0,  0) ),
    Label(  'rectification border' ,  2 ,      19 , 'void'            , 0       , False        , True         , (  0,  0,  0) ),
    Label(  'out of roi'           ,  3 ,      19 , 'void'            , 0       , False        , True         , (  0,  0,  0) ),
    Label(  'static'               ,  4 ,      19 , 'void'            , 0       , False        , True         , (  0,  0,  0) ),
    Label(  'dynamic'              ,  5 ,      19 , 'void'            , 0       , False        , True         , (111, 74,  0) ),
    Label(  'ground'               ,  6 ,      19 , 'void'            , 0       , False        , True         , ( 81,  0, 81) ),
    Label(  'road'                 ,  7 ,        0 , 'flat'            , 1       , False        , False        , (128, 64,128) ),
    Label(  'sidewalk'             ,  8 ,        1 , 'flat'            , 1       , False        , False        , (244, 35,232) ),
    Label(  'parking'              ,  9 ,      19 , 'flat'            , 1       , False        , True         , (250,170,160) ),
    Label(  'rail track'           , 10 ,      19 , 'flat'            , 1       , False        , True         , (230,150,140) ),
    Label(  'building'             , 11 ,        2 , 'construction'    , 2       , False        , False        , ( 70, 70, 70) ),
    Label(  'wall'                 , 12 ,        3 , 'construction'    , 2       , False        , False        , (102,102,156) ),
    Label(  'fence'                , 13 ,        4 , 'construction'    , 2       , False        , False        , (190,153,153) ),
    Label(  'guard rail'           , 14 ,      19 , 'construction'    , 2       , False        , True         , (180,165,180) ),
    Label(  'bridge'               , 15 ,      19 , 'construction'    , 2       , False        , True         , (150,100,100) ),
    Label(  'tunnel'               , 16 ,      19 , 'construction'    , 2       , False        , True         , (150,120, 90) ),
    Label(  'pole'                 , 17 ,        5 , 'object'          , 3       , False        , False        , (153,153,153) ),
    Label(  'polegroup'            , 18 ,      19 , 'object'          , 3       , False        , True         , (153,153,153) ),
    Label(  'traffic light'        , 19 ,        6 , 'object'          , 3       , False        , False        , (250,170, 30) ),
    Label(  'traffic sign'         , 20 ,        7 , 'object'          , 3       , False        , False        , (220,220,  0) ),
    Label(  'vegetation'           , 21 ,        8 , 'nature'          , 4       , False        , False        , (107,142, 35) ),
    Label(  'terrain'              , 22 ,        9 , 'nature'          , 4       , False        , False        , (152,251,152) ),
    Label(  'sky'                  , 23 ,       10 , 'sky'             , 5       , False        , False        , ( 70,130,180) ),
    Label(  'person'               , 24 ,       11 , 'human'           , 6       , True         , False        , (220, 20, 60) ),
    Label(  'rider'                , 25 ,       12 , 'human'           , 6       , True         , False        , (255,  0,  0) ),
    Label(  'car'                  , 26 ,       13 , 'vehicle'         , 7       , True         , False        , (  0,  0,142) ),
    Label(  'truck'                , 27 ,       14 , 'vehicle'         , 7       , True         , False        , (  0,  0, 70) ),
    Label(  'bus'                  , 28 ,       15 , 'vehicle'         , 7       , True         , False        , (  0, 60,100) ),
    Label(  'caravan'              , 29 ,      19 , 'vehicle'         , 7       , True         , True         , (  0,  0, 90) ),
    Label(  'trailer'              , 30 ,      19 , 'vehicle'         , 7       , True         , True         , (  0,  0,110) ),
    Label(  'train'                , 31 ,       16 , 'vehicle'         , 7       , True         , False        , (  0, 80,100) ),
    Label(  'motorcycle'           , 32 ,       17 , 'vehicle'         , 7       , True         , False        , (  0,  0,230) ),
    Label(  'bicycle'              , 33 ,       18 , 'vehicle'         , 7       , True         , False        , (119, 11, 32) ),
    Label(  'license plate'        , -1 ,       19 , 'vehicle'         , 7       , False        , True         , (  0,  0,142) ),
]

Traceback:
./train.py -c ~/bonnetal/train/tasks/segmentation/config/cityscapes/ERFNet.yaml -l ~/bonnetal/train/tasks/segmentation/log1
/home/cris/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:516: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint8 = np.dtype([("qint8", np.int8, 1)])
/home/cris/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:517: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint8 = np.dtype([("quint8", np.uint8, 1)])
/home/cris/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:518: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint16 = np.dtype([("qint16", np.int16, 1)])
/home/cris/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:519: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint16 = np.dtype([("quint16", np.uint16, 1)])
/home/cris/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:520: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint32 = np.dtype([("qint32", np.int32, 1)])
/home/cris/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:525: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  np_resource = np.dtype([("resource", np.ubyte, 1)])
/home/cris/.local/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:541: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint8 = np.dtype([("qint8", np.int8, 1)])
/home/cris/.local/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:542: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint8 = np.dtype([("quint8", np.uint8, 1)])
/home/cris/.local/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:543: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint16 = np.dtype([("qint16", np.int16, 1)])
/home/cris/.local/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:544: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint16 = np.dtype([("quint16", np.uint16, 1)])
/home/cris/.local/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:545: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint32 = np.dtype([("qint32", np.int32, 1)])
/home/cris/.local/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:550: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  np_resource = np.dtype([("resource", np.ubyte, 1)])
----------
INTERFACE:
config yaml:  /home/cris/bonnetal/train/tasks/segmentation/config/cityscapes/ERFNet.yaml
log dir /home/cris/bonnetal/train/tasks/segmentation/log1
model path None
eval only False
No batchnorm False
----------

Commit hash (training version):  b'5368eed'
----------

Opening config file /home/cris/bonnetal/train/tasks/segmentation/config/cityscapes/ERFNet.yaml
No pretrained directory found.
Copying files to /home/cris/bonnetal/train/tasks/segmentation/log1 for further reference.
WARNING:tensorflow:From ../../common/logger.py:16: The name tf.summary.FileWriter is deprecated. Please use tf.compat.v1.summary.FileWriter instead.

Images from:  ~/bonnetal/cityscapes/leftImg8bit/train
Labels from:  ~/bonnetal/cityscapes/gtFine/train
LENGTH 2975 2975
Inference batch size:  4
Images from:  ~/bonnetal/cityscapes/leftImg8bit/val
Labels from:  ~/bonnetal/cityscapes/gtFine/val
LENGTH 500 500
Original OS:  8
New OS:  8
Trying to get backbone weights online from Bonnetal server.
Using pretrained weights from bonnetal server for backbone
OS:  1 , channels:  16
OS:  2 , channels:  16
OS:  4 , channels:  64
[Decoder] os:  4 in:  128 skip: 64 out:  64
[Decoder] os:  2 in:  64 skip: 16 out:  16
[Decoder] os:  1 in:  16 skip: 3 out:  16
Using normalized weights as bias for head.
No path to pretrained, using bonnetal Imagenet backbone weights and random decoder.
Total number of parameters:  2252148
Total number of parameters requires_grad:  2252148
Param encoder  1913168
Param decoder  338640
Param head  340
Training in device:  cuda
/home/cris/.local/lib/python3.6/site-packages/torch/optim/lr_scheduler.py:100: UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`. In PyTorch 1.1.0 and later, you should call them in the opposite order: `optimizer.step()` before `lr_scheduler.step()`.  Failure to do this will result in PyTorch skipping the first value of the learning rate schedule.See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
  "https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate", UserWarning)
Ignoring class  19  in IoU evaluation
[IOU EVAL] IGNORE:  tensor([19])
[IOU EVAL] INCLUDE:  tensor([ 0,  1,  2,  3,  4,  5,  6,  7,  8,  9, 10, 11, 12, 13, 14, 15, 16, 17,
        18])
Let's see if it finishes this
/pytorch/aten/src/THCUNN/SpatialClassNLLCriterion.cu:104: void cunn_SpatialClassNLLCriterion_updateOutput_kernel(T *, T *, T *, long *, T *, int, int, int, int, int, long) [with T = float, AccumT = float]: block: [1,0,0], thread: [576,0,0] Assertion `t >= 0 && t < n_classes` failed.
/pytorch/aten/src/THCUNN/SpatialClassNLLCriterion.cu:104: void cunn_SpatialClassNLLCriterion_updateOutput_kernel(T *, T *, T *, long *, T *, int, int, int, int, int, long) [with T = float, AccumT = float]: block: [1,0,0], thread: [577,0,0] Assertion `t >= 0 && t < n_classes` failed.
/pytorch/aten/src/THCUNN/SpatialClassNLLCriterion.cu:104: void cunn_SpatialClassNLLCriterion_updateOutput_kernel(T *, T *, T *, long *, T *, int, int, int, int, int, long) [with T = float, AccumT = float]: block: [1,0,0], thread: [578,0,0] Assertion `t >= 0 && t < n_classes` failed.
/pytorch/aten/src/THCUNN/SpatialClassNLLCriterion.cu:104: void cunn_SpatialClassNLLCriterion_updateOutput_kernel(T *, T *, T *, long *, T *, int, int, int, int, int, long) [with T = float, AccumT = float]: block: [1,0,0], thread: [579,0,0] Assertion `t >= 0 && t < n_classes` failed.
Traceback (most recent call last):
  File "./train.py", line 117, in <module>
    trainer.train()
  File "../../tasks/segmentation/modules/trainer.py", line 302, in train
    scheduler=self.scheduler)
  File "../../tasks/segmentation/modules/trainer.py", line 488, in train_epoch
    loss.backward()
  File "/home/cris/.local/lib/python3.6/site-packages/torch/tensor.py", line 166, in backward
    torch.autograd.backward(self, gradient, retain_graph, create_graph)
  File "/home/cris/.local/lib/python3.6/site-packages/torch/autograd/__init__.py", line 99, in backward
    allow_unreachable=True)  # allow_unreachable flag
RuntimeError: cuDNN error: CUDNN_STATUS_NOT_INITIALIZED

```


dev work

Also some observations in the dependencies:

Quite a few dependencies are out of date. (mini-css-extract-plugin latest v2.20, sass-loader, ts-loader etc)
Some dependencies should be in dev dependencies instead of dependencies (url-loader, webpack-dev-server, react-hot-loader, postcss, webpack-manifest-plugin, workbox-webpack-plugin etc)


Remove sentry elements at the start of ways/relations

LGTM, but that gave me an additional idea - why not build a very small region in Travis CI to validate those kind of changes?


Tile 7471 on 20230512 has a serie ~30 dubious redshifts

tileid 7471 (expid=180299 on 20230512) has been marked as unsure, as it has a suspicious patch of approx. 30 spectra at z~0.065 at 3400<fiber<3500, with the redshift drifting with fiber.
there s a peak at ~5300A in the spectra, even in the stuck-sky ones, which is interpreted as oiii.
I attach one example; the ~30 spectra are available here: https://data.desi.lbl.gov/desi/users/raichoor/tmpdir/tmp-7471-thru20230512-dubious.pdf.

This is due to a very strange CCD-level event on B6 originating at (x,y) ~ (4048,3067), then bleeding to the left.  It's not a sharp enough feature to be flagged as a CR.  Not sure I've seen anything like this before.

While I'm normally hesitant to add special case handling of rare events, we could consider something like a desi_spectro_calib extramask.csv file that would define
NIGHT EXPID CAMERA XMIN XMAX YMIN YMAX COMMENT

The code could use that to add an extra per-exposure per-camera custom CCD mask, to use for cases like this to flag a small patch of the CCD instead of having to discard the entire amp.

We discussed this in the DailyOps meeting today.  The outcome is that we wanted to leave this open for one week to see if handling along the lines Stephen suggests would be straightforward.  If so, reprocess with that feature.  If not, mark the amp as bad and reprocess.

This tile 7471 has been reprocessed and tsnr/tiles-daily rerun for 20230512 using the fix from desihub/desispec#2048.  i.e. it is ready for QA again.  @schlafly or others, please close this ticket after the tile is accepted, or otherwise post any remaining problems found.

Marked good, closing!


hardware filter to promiscuous mode

I have installed the latest wincap library and attempted to use tracetcp and I get the following message
which I believe may be related to my wireless connection.
failed to set hardware filter to promiscuous mode
I was using the tracetcp as part of a batch file which allows me to simply input a couple of digits to instruct the program as to what server and port I wish to test.  The program returns that error msg.
If I try to execute tracetcp.exe all I get is a micro second view of what may be a cmd prompt screen and it is instantly closed and i receive no msg.
In researching the issue I found that those that are using wireshark which also uses wincap have had the same error.
MY OS is WIN XP sp3  and I am using Netgear WPN 311 wireless pci adapter w/ latest netgear driver installed.
Is there a resolution to this problem?
thanks
ehg

I have found that winpcap will not capture packets from WiFi adapters on Windows XP. However it generally does on windows 7 & and above (and  possibly vista but I have not tried it)
Unfortunately this seems to be a limitation of XP so there is no work around possible in tracetcp.
The only thing I can suggest is to use a later version of windows.

Well I won't give up XP until absolutely forced too - Only gave up Win2000 Pro because I built a new box and the amd chipset did not support anything prior to xp!

I will try however to hardwire my box to my router/modem since my box also has a regular nic installed and see if that works

thanks for the timely reply

ehgOn Thu, 16 Apr 2015 15:37:56 -0700, Lee Witek wrote:>�I have found that winpcap will not capture packets from WiFi adapters on Windows XP. However it generally does on windows 7 &�and above (and possibly vista but I have not tried it)>>�Unfortunately this seems to be a limitation of XP so there is no work around possible in tracetcp.>>�The only thing I can suggest is to use a later version of windows.>>��>�Reply to this email directly or view it on GitHub.


Docker image building gives: "JAVA_HOME should point to a JDK not a JRE"

Describe the bug
 docker build -t porting-advisor .
[+] Building 21.8s (8/10)
 => [internal] load build definition from Dockerfile                                                                                0.2s
 => => transferring dockerfile: 38B                                                                                0.1s
 => [internal] load .dockerignore                                                                                0.2s
 => => transferring context: 2B                                                                                0.1s
 => [internal] load metadata for docker.io/library/ubuntu:22.04                                                                                0.7s
 => [internal] load build context                                                                                5.5s
 => => transferring context: 31.35kB                                                                                5.4s
 => CACHED [builder 1/5] FROM docker.io/library/ubuntu:22.04@sha256:0bced47fffa3361afa981854fcabcd4577cd43cebbb808cea2b1f33a3dd7f508                                          0.0s
 => CACHED [builder 2/5] RUN apt update     && apt install -y python3.11 python3.11-dev python3.11-venv python3-pip openjdk-17-jdk maven binutils     && apt clean            0.0s
 => [builder 3/5] COPY . /root/                                                                                0.2s
 => ERROR [builder 4/5] RUN cd /root/ && /usr/bin/python3.11 -m venv .venv     && source .venv/bin/activate     && python3 -m pip install -r requirements-build.txt     &&   15.1s
------
 > [builder 4/5] RUN cd /root/ && /usr/bin/python3.11 -m venv .venv     && source .venv/bin/activate     && python3 -m pip install -r requirements-build.txt     && FILE_NAME=porting-advisor ./build.sh:
#8 7.525 Collecting altgraph==0.17.2
#8 7.792   Downloading altgraph-0.17.2-py2.py3-none-any.whl (21 kB)
#8 7.936 Collecting certifi==2022.12.7
#8 7.953   Downloading certifi-2022.12.7-py3-none-any.whl (155 kB)
#8 8.008      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.3/155.3 KB 3.3 MB/s eta 0:00:00
#8 8.204 Collecting charset-normalizer==2.1.1
#8 8.216   Downloading charset_normalizer-2.1.1-py3-none-any.whl (39 kB)
#8 9.075 Collecting coverage==7.0.1
#8 9.091   Downloading coverage-7.0.1-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (219 kB)
#8 9.148      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 219.8/219.8 KB 5.9 MB/s eta 0:00:00
#8 9.189 Collecting idna==3.4
#8 9.200   Downloading idna-3.4-py3-none-any.whl (61 kB)
#8 9.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.5/61.5 KB 2.9 MB/s eta 0:00:00
#8 9.281 Collecting Jinja2==3.1.2
#8 9.293   Downloading Jinja2-3.1.2-py3-none-any.whl (133 kB)
#8 9.331      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.1/133.1 KB 4.3 MB/s eta 0:00:00
#8 9.469 Collecting MarkupSafe==2.1.1
#8 9.481   Downloading MarkupSafe-2.1.1.tar.gz (18 kB)
#8 9.502   Preparing metadata (setup.py): started
#8 9.958   Preparing metadata (setup.py): finished with status 'done'
#8 10.01 Collecting packaging==21.3
#8 10.03   Downloading packaging-21.3-py3-none-any.whl (40 kB)
#8 10.04      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.8/40.8 KB 2.7 MB/s eta 0:00:00
#8 10.07 Collecting progressbar33==2.4
#8 10.09   Downloading progressbar33-2.4.tar.gz (10 kB)
#8 10.10   Preparing metadata (setup.py): started
#8 10.50   Preparing metadata (setup.py): finished with status 'done'
#8 10.61 Collecting pyinstaller==5.5
#8 10.62   Downloading pyinstaller-5.5-py3-none-manylinux2014_x86_64.whl (593 kB)
#8 10.74      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 593.2/593.2 KB 4.9 MB/s eta 0:00:00
#8 10.79 Collecting pyinstaller-hooks-contrib==2022.4
#8 10.80   Downloading pyinstaller_hooks_contrib-2022.4-py2.py3-none-any.whl (229 kB)
#8 10.85      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 229.4/229.4 KB 5.0 MB/s eta 0:00:00
#8 10.94 Collecting pyparsing==3.0.9
#8 10.95   Downloading pyparsing-3.0.9-py3-none-any.whl (98 kB)
#8 10.98      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.3/98.3 KB 3.6 MB/s eta 0:00:00
#8 11.05 Collecting requests==2.31.0
#8 11.06   Downloading requests-2.31.0-py3-none-any.whl (62 kB)
#8 11.09      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 KB 2.8 MB/s eta 0:00:00
#8 11.17 Collecting urllib3==1.26.13
#8 11.18   Downloading urllib3-1.26.13-py2.py3-none-any.whl (140 kB)
#8 11.22      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.6/140.6 KB 3.7 MB/s eta 0:00:00
#8 11.34 Collecting XlsxWriter==3.0.3
#8 11.35   Downloading XlsxWriter-3.0.3-py3-none-any.whl (149 kB)
#8 11.40      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 150.0/150.0 KB 3.2 MB/s eta 0:00:00
#8 11.46 Requirement already satisfied: setuptools in ./.venv/lib/python3.11/site-packages (from pyinstaller==5.5->-r requirements-build.txt (line 10)) (59.6.0)
#8 11.61 Using legacy 'setup.py install' for MarkupSafe, since package 'wheel' is not installed.
#8 11.61 Using legacy 'setup.py install' for progressbar33, since package 'wheel' is not installed.
#8 11.70 Installing collected packages: progressbar33, altgraph, XlsxWriter, urllib3, pyparsing, pyinstaller-hooks-contrib, MarkupSafe, idna, coverage, charset-normalizer, certifi, requests, pyinstaller, packaging, Jinja2
#8 11.70   Running setup.py install for progressbar33: started
#8 12.18   Running setup.py install for progressbar33: finished with status 'done'
#8 12.92   Running setup.py install for MarkupSafe: started
#8 13.95   Running setup.py install for MarkupSafe: finished with status 'done'
#8 14.88 Successfully installed Jinja2-3.1.2 MarkupSafe-2.1.1 XlsxWriter-3.0.3 altgraph-0.17.2 certifi-2022.12.7 charset-normalizer-2.1.1 coverage-7.0.1 idna-3.4 packaging-21.3 progressbar33-2.4 pyinstaller-5.5 pyinstaller-hooks-contrib-2022.4 pyparsing-3.0.9 requests-2.31.0 urllib3-1.26.13
#8 15.04 *** Will use porting-advisor as name ***
#8 15.05 The JAVA_HOME environment variable is not defined correctly
#8 15.05 This environment variable is needed to run this program
#8 15.05 NB: JAVA_HOME should point to a JDK not a JRE
#8 15.05 **ERROR**: error generating jar for Ampere Ready Java tool
------
executor failed running [/bin/bash -c cd /root/ && /usr/bin/python3.11 -m venv .venv     && source .venv/bin/activate     && python3 -m pip install -r requirements-build.txt     && FILE_NAME=porting-advisor ./build.sh]: exit code: 1

Expected behavior
I was expecting the image building to go up to the end.
Steps to Reproduce
docker build -t porting-advisor .
Screenshots
No.
Desktop (please complete the following information)

OS: Debian under WSL2 (Windows 11)
Version/Distro: Bullseye
Processor Architecture: x86_64
Python Version: all through docker
Java Version (if applicable): all through docker
Docker: Docker version 20.10.24, build 297e128

Additional context

I also tried it on an Oracle Cloud amd64 machine running Ubuntu, and got the same result.
Successfully installed Jinja2-3.1.2 MarkupSafe-2.1.1 XlsxWriter-3.0.3 altgraph-0.17.2 certifi-2022.12.7 charset-normalizer-2.1.1 coverage-7.0.1 idna-3.4 packaging-21.3 progressbar33-2.4 pyinstaller-5.5 pyinstaller-hooks-contrib-2022.4 pyparsing-3.0.9 requests-2.31.0 urllib3-1.26.13
*** Will use porting-advisor as name ***
**ERROR**: error generating jar for Ampere Ready Java tool
The JAVA_HOME environment variable is not defined correctly
This environment variable is needed to run this program
NB: JAVA_HOME should point to a JDK not a JRE
The command '/bin/bash -c cd /root/ && /usr/bin/python3.11 -m venv .venv     && source .venv/bin/activate     && python3 -m pip install -r requirements-build.txt     && FILE_NAME=porting-advisor ./build.sh' returned a non-zero code: 1

It did work on an aarch64 Oracle cloud machine (Ampere-based):
docker build -t porting-advisor .
[+] Building 110.7s (12/12) FINISHED                                                                                docker:default
 => [internal] load .dockerignore                                                                                0.0s
 => => transferring context: 2B                                                                                0.0s
 => [internal] load build definition from Dockerfile                                                                                0.0s
 => => transferring dockerfile: 750B                                                                                0.0s
 => [internal] load metadata for docker.io/library/ubuntu:22.04                                                                                1.4s
 => [auth] library/ubuntu:pull token for registry-1.docker.io                                                                                0.0s
 => [internal] load build context                                                                                0.1s
 => => transferring context: 939.78kB                                                                                0.0s
 => [builder 1/5] FROM docker.io/library/ubuntu:22.04@sha256:0bced47fffa3361afa981854fcabcd4577cd43cebbb808cea2b1f33a3dd7f508                  1.2s
 => => resolve docker.io/library/ubuntu:22.04@sha256:0bced47fffa3361afa981854fcabcd4577cd43cebbb808cea2b1f33a3dd7f508                          0.0s
 => => sha256:5af00eab97847634d0b3b8a5933f52ca8378f5f30a2949279d682de1e210d78b 27.35MB / 27.35MB                                               0.4s
 => => sha256:0bced47fffa3361afa981854fcabcd4577cd43cebbb808cea2b1f33a3dd7f508 1.13kB / 1.13kB                                                 0.0s
 => => sha256:fb4a67ec973b2995214edd101e37a83787b175a16750b372789c8f6314dc20ca 424B / 424B                                                     0.0s
 => => sha256:37f74891464b2067aacbde60d9e2888e002af047a0d5dfc0b06b701928e0b473 2.31kB / 2.31kB                                                 0.0s
 => => extracting sha256:5af00eab97847634d0b3b8a5933f52ca8378f5f30a2949279d682de1e210d78b                                                      0.7s
 => [builder 2/5] RUN apt update     && apt install -y python3.11 python3.11-dev python3.11-venv python3-pip openjdk-17-jdk maven binutils    70.8s
 => [builder 3/5] COPY . /root/                                                                                0.1s
 => [builder 4/5] RUN cd /root/ && /usr/bin/python3.11 -m venv .venv     && source .venv/bin/activate     && python3 -m pip install -r requi  36.5s
 => [builder 5/5] RUN mv /root/dist/porting-advisor /opt/porting-advisor                                                                       0.5s
 => [runtime 2/2] COPY --from=builder /opt/porting-advisor /usr/bin/porting-advisor                                                            0.1s
 => exporting to image                                                                                0.1s
 => => exporting layers                                                                                0.0s
 => => writing image sha256:bb9401b2c5ec2b2cd847324c2a156cf5eedf437ecb0a753121af6ca85d40a749                                                   0.0s
 => => naming to docker.io/library/porting-advisor

I don't know if this is linked to the previous error, but on aarch64 I got

java is not installed. We need java to scan jar files for native methods

when scanning the Jenkins core source code:
docker run --rm -v ./jenkins:/repo porting-advisor /repo
| Elapsed Time: 0:00:00                                                        .java

Porting Advisor for Ampere Processors v1.0.2
Report date: 2023-07-19 07:46:26

1749 files scanned.
detected java code. we recommend using OpenJDK version 17 or above release for aarch64. see https://github.com/AmpereComputing/ampere-porting-advisor/blob/main/doc/java.md#prebuilt-java-release for more details.
detected python code. if you need pip, version 19.3 or above is recommended.
detected java code. min version 8 is required. version 17 or above is recommended. see https://github.com/AmpereComputing/ampere-porting-advisor/blob/main/doc/java.md for more details.
detected python code. min version 3.7.5 is required. see https://github.com/AmpereComputing/ampere-porting-advisor/blob/main/doc/python.md for more details.
java is not installed. We need java to scan jar files for native methods

Report generated successfully. Hint: you can use --output FILENAME.html to generate an HTML report.

Hi @gounthar , thanks for reaching out.
The issue you mentioned are related to Java settings in container, we will fix them in later version.
Porting advisor can be executed as python script or binary before new version arrival, hope this will unblock your usage for porting advisor, thanks.

Hi @gounthar, we have pushed a correction for Java settings in container which will fix errors in this post.
Let us know if you still need our support on this issue, thanks.

Thank you so much, it now works for me. 👍


Proposal: Disabled Capabilities by Default II

I think we should enable all commands by default. However I would like to hear why this could be a bad idea before turning this into an official task.

Skipping /multiplier because it is disabled on this repo

I wonder if it makes sense to enable all of the slash commands by default. This is because partners must go out of their way to use those commands, whereas the other capabilities of the bot are more "automatic"

"automatic" like assistive pricing, adding labels, automatic payments etc.
Originally posted by @pavlovcik in https://github.com/ubiquity/ubiquibot/issues/595#issuecomment-1673214378

I think we should enable all commands by default. However I would like to hear why this could be a bad idea before turning this into an official task.

Skipping /multiplier because it is disabled on this repo

I wonder if it makes sense to enable all of the slash commands by default. This is because partners must go out of their way to use those commands, whereas the other capabilities of the bot are more "automatic"

"automatic" like assistive pricing, adding labels, automatic payments etc.
Originally posted by @pavlovcik in #595 (comment)

I think it's ok to enable all of the features by default

To clarify, I am talking about slash commands only. The other features I fear that they might annoy or get in the way for new partners who don't fully understand all of the capabilities. I am not confident with even the slash commands because imagine if new onboarded partners dont want bounty hunters to automatically be able to assign themselves?

Skipping /start because it is disabled on this repo

Maybe you can enable all the slash commands on the org defaults?

Skipping /start because it is disabled on this repo

Maybe you can enable all the slash commands on the org defaults?
To clarify, I am talking about slash commands only. The other features I fear that they might annoy or get in the way for new partners who don't fully understand all of the capabilities. I am not confident with even the slash commands because imagine if new onboarded partners dont want bounty hunters to automatically be able to assign themselves?

https://github.com/ubiquity/ubiquibot-config/pull/9


Gradient.reverse() appears broken.

Godot version
4.0.1
System information
Ubuntu 22.04.1 LTS
Issue description
Reversing a gradient causes its first color to dominate. Reversing it back to how it was fixes it.
Here's a TextureRect with a GradientTexture1D that calls texture.gradient.reverse() periodically:
https://user-images.githubusercontent.com/85438892/226996337-d2e38c80-06fc-4ab8-bfcc-dd561575122d.mp4
Steps to reproduce
Pretty much explained above. Also see the MRP.
Minimal reproduction project
BrokenGradientReverse.zip

Looks like it doesn't update sorting correctly, will see if I can fix

I see! This was a major strain on my Gradient Editor PR, I had to do
pts.sort();
gradient->set_points(pts);```


Wrong supported models for macOS Ventura

The JSON model_identifier_ventura.json lists MacBookAir7,2 as compatible with macOS Ventura, which is incorrect. On https://support.apple.com/en-ca/102869 it says Newest compatible operating system: macOS Monterey.

Thanks, we’ll look into that to correct this.


text2text.py data pipeline inefficiency

There are some inefficiencies with applying a shard after cache in text2text.py build_graph method.  Rewriting part of the code such that the shard is called first before map, cache results in a pretty sizable decrease in time per step when training big transformer on wmt14 en-de.  Happy to provide a pull request.  On 4 nodes, 32 gpus, batch size 128, iter size 16, mixed precision training, 16gb voltas, I've noticed time per step drop from 13.9s without the fix below to 6.6s with the following code change in the dataset pipeline.
  def build_graph(self):
    _sources = tf.data.TextLineDataset(self.source_file)

    if self._num_workers > 1:
      _sources = _sources.shard(num_shards=self._num_workers, index=self._worker_id)

    _sources = _sources.map(lambda line: tf.py_func(func=self._src_token_to_id, inp=[line],
                                   Tout=[tf.int32], stateful=False),
           num_parallel_calls=self._map_parallel_calls) \
      .map(lambda tokens: (tokens, tf.size(tokens)),
           num_parallel_calls=self._map_parallel_calls)

    _targets = tf.data.TextLineDataset(self.target_file) \

    if self._num_workers > 1:
      _targets = _targets.shard(num_shards=self._num_workers, index=self._worker_id)

    _targets = _targets.map(lambda line: tf.py_func(func=self._tgt_token_to_id, inp=[line],
                                   Tout=[tf.int32], stateful=False),
           num_parallel_calls=self._map_parallel_calls) \
      .map(lambda tokens: (tokens, tf.size(tokens)),
           num_parallel_calls=self._map_parallel_calls)

    _src_tgt_dataset = tf.data.Dataset.zip((_sources, _targets)).filter(
      lambda t1, t2: tf.logical_and(tf.less_equal(t1[1], self.max_len),
                                    tf.less_equal(t2[1], self.max_len))
    ).cache()

#204

Thanks @vsuthichai ! It does seem to make a big difference if horovod isn't used.
Is this what you meant: https://github.com/NVIDIA/OpenSeq2Seq/issues/243 ?
My only concern is whether shard is deterministic or not (it seems such) so that mapping between src and tgt is preserved

@okuchaiev Sorry, I didn't specify this earlier.  All experiments I've been doing are using Horovod, but yes, that appears to be the correct fix 👍

thx!
btw we changed license to Apache 2.0 so that it is easier for external people to send PRs https://github.com/NVIDIA/OpenSeq2Seq/blob/18.11-dev/LICENSE
(it currently shows MIT but this is because we haven't "released" 18.11 yet)


Patch to allow opencv_contrib modules

For my Mechatronics course, I wanted to add the opencv_contrib modules because we use the opencv_contrib aruco module for tracking robots for a midterm project. This script is awesome and saved me loads of time. Attached is the results of "git diff" to add this as an option through a YES/NO variable at the top of the file (like is already done for opencv_extras).
If you want me to fork and make this into a pull request, I can, but thought a patch might be easier for others to find/apply than navigate a fork and leaves your repository as the authoritative source.
add_opencv_contrib_option_diff.txt

Excellent! Thank you kindly.


[Accessibility] Problem with text scaling on ios

Steps to reproduce

Use Flutter 3.24.5 or newer;
Create a new project;
Build for web;
Publish on a web server;
Using chrome on Ios, try to increase text size using chrome zoom text setting

Expected results
On all Flutter versions using a new project, should increase and decrease text size using chrome zoom text setting.
Actual results
It is working with Flutter 3.22.2 but not with Flutter 3.24.5 or Flutter 3.27.1.
We also have the same problem using add-to-app feature, only in iOS. On android it works well.
Code sample
Code sample with Flutter 3.22.2
Flutter 3.22.2 example: https://github.com/gianlucainnocente/flutter-3222

Code sample with Flutter 3.27.1
Flutter 3.27.1 example: https://github.com/gianlucainnocente/flutter-3271

Screenshots or Video
Flutter 3.22.2: http://vps-1a54a8e7.vps.ovh.net/322
Flutter 3.24.5: http://vps-1a54a8e7.vps.ovh.net/324
Flutter 3.27.1: http://vps-1a54a8e7.vps.ovh.net/327
Logs
No response
Flutter Doctor output
Doctor output 3.22.2
[✓] Flutter (Channel stable, 3.22.2, on macOS 15.1.1 24B2091 darwin-arm64, locale it-IT)
[!] Android toolchain - develop for Android devices (Android SDK version 34.0.0)
    ! Some Android licenses not accepted. To resolve this, run: flutter doctor --android-licenses
[✓] Xcode - develop for iOS and macOS (Xcode 15.4)
[✓] Chrome - develop for the web
[✓] Android Studio (version 2022.2)
[✓] Android Studio (version 2022.1)
[✓] IntelliJ IDEA Ultimate Edition (version 2024.2.4)
[✓] VS Code (version 1.96.0)
[✓] Network resources

Doctor output 3.27.1
[✓] Flutter (Channel stable, 3.27.1, on macOS 15.1.1 24B2091 darwin-arm64, locale it-IT)
[!] Android toolchain - develop for Android devices (Android SDK version 34.0.0)
    ! Some Android licenses not accepted. To resolve this, run: flutter doctor --android-licenses
[✓] Xcode - develop for iOS and macOS (Xcode 15.4)
[✓] Chrome - develop for the web
[✓] Android Studio (version 2022.2)
[✓] Android Studio (version 2022.1)
[✓] IntelliJ IDEA Ultimate Edition (version 2024.2.4)
[✓] VS Code (version 1.96.0)

Reproducible using the counter app. The text zoom works as expected in Safari but not in chrome.
On Stable 3.22.3, the buttons respond, but the zoom, doesn't look good. On the latest stable/master, it doesn't respond at all.

stable 3.22.3
latest stable & master

flutter doctor -v
[✓] Flutter (Channel stable, 3.27.1, on macOS 15.1.1 24B91 darwin-arm64, locale en-US)
    • Flutter version 3.27.1 on channel stable at /Users/deanli/dev/stable
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 17025dd882 (19 hours ago), 2024-12-17 03:23:09 +0900
    • Engine revision cb4b5fff73
    • Dart version 3.6.0
    • DevTools version 2.40.2

[!] Flutter (Channel master, 3.28.0-1.0.pre.157, on macOS 15.1.1 24B91 darwin-arm64, locale en-US)
    • Flutter version 3.28.0-1.0.pre.157 on channel master at /Users/deanli/dev/master
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 27ef1967b0 (9 hours ago), 2024-12-16 20:29:14 -0800
    • Engine revision 23731d6a96
    • Dart version 3.7.0 (build 3.7.0-256.0.dev)
    • DevTools version 2.41.0

Reproducible using the counter app. The text zoom works as expected in Safari but not in chrome. On Stable 3.22.3, the buttons respond, but the zoom, doesn't look good. On the latest stable/master, it doesn't respond at all.
stable 3.22.3	latest stable & master
ScreenRecording_12-17-2024.12-50-47_1.MP4
ScreenRecording_12-17-2024.12-53-46_1.MP4
flutter doctor -v

Hello, exactly!
We also have the same problem integrating the app with Flutter 3.24.5 as an xcframework in an existing ios app. It was working well with 3.22.2.
Thank you

We also have the same problem integrating the app with Flutter 3.24.5 as an xcframework in an existing ios app. It was working well with 3.22.2.

Kindly file a new issue for this and provide all the relevant information required.
Thank you


keyv needs to be set on encryption operation rather than id generation

Currently the keyv field is set within createUserCookiesOnDigitrustDomain() in pages/redirect.html. However at that time the id value is not yet encrypted at all.
The value sent in keyv needs to be set within pages/dt.html at the time of encryption, currently in this block of code.
                            DigiTrustCrypto.encrypt(digiTrustUserJSON.id, function (encryptedUserId) {
                                digiTrustUserJSON.id = encryptedUserId;
                                sendMessage(digiTrustUserJSON);
                            });

Fixed in 1.2.0


TO-DO: Denoising approach

Convolutional U-Nets can be used to predict a denoised output given the noisy input (https://www.sciencedirect.com/science/article/pii/S0952197622004973). The idea is

U-Net Model input: Noisy signal (here, from MBSG hearing loss attenuated signal)
Output for training: Original signal (may even pair with DEMUCS?)
Find the difference
Apply the difference to the original signal (assuming that the user's hearing loss will attenuate perceptually)

How should the diff be applied? Time-domain? Frequency-domain? MFCC? Something else?


aio app pack: Cannot set properties of undefined (setting 'code-download')

Describe the bug
Cannot set properties of undefined (setting 'code-download') is thrown in two cases that should be handled:

if the action is missing an annotation object
if the action configuration is included in a separate configuration file. In fact, the command looks for the file that defines the runtimeManifest, however the action configuration (or even the annotation object) could be included in a downstream configuration file. This requires a change in the way the index is processed.

Expected behavior
no errors

@moritzraho Can this be closed?

JIRA issue was closed and PR merged


Fix parent_label

On MS Windows tests were not passing
The problem was that os.path.sep was used in parent_label. However if path passed to the method was using *nix separators '/' it was breaking.
Another small bug was just in tests for RegexLabeller - regexp was assuming '/' as a separator

It's weird that os.path.sep doesn't return the right thing on Windows. In any case I think the correct fix is to use Path.split. Merging this for the fix on RegexLabeller and will push a follow-up commit using Path.split for parent labeler.


Detect {:termination false} on traits in the Auditor

This is implemented in dafny-lang/dafny#3175.


dsm rctest num_values return

@smithandrewc @LorenzMeier dsm_parse() was changed here and causes the rc tests to fail if built with optimization - https://github.com/PX4/Firmware/commit/12a34c9fcfd184dac7cdb1e10ae1444274aefba0#diff-a4fb34c61c3e2506bd9bfcf1f7151356
num_values is passed in and not necessarily initialized.
If you run the rc test locally with optimization on it should fail. make tests
In the builds the tests are currently only running on OSX and on Linux built for test coverage. Neither were failing.
INFO  [rc_tests] RUNNING TEST: dsmTest10Ch
INFO  [rc_tests] frame dropped, now #1
INFO  [rc_tests] frame dropped, now #2
INFO  [rc_tests] frame dropped, now #3
INFO  [rc_tests] frame dropped, now #4
INFO  [rc_tests] frame dropped, now #5
ERROR [modules__unit_test] Assertion failed: test - num_values == expected_chancount (../src/lib/rc/rc_tests/RCTest.cpp:106)
ERROR [rc_tests] TEST FAILED: dsmTest10Ch
INFO  [rc_tests] RUNNING TEST: dsmTest12Ch
INFO  [rc_tests] frame dropped, now #1
INFO  [rc_tests] frame dropped, now #2
INFO  [rc_tests] frame dropped, now #3
INFO  [rc_tests] frame dropped, now #4
INFO  [rc_tests] frame dropped, now #5
INFO  [rc_tests] frame dropped, now #6
ERROR [modules__unit_test] Assertion failed: test - num_values == expected_chancount (../src/lib/rc/rc_tests/RCTest.cpp:106)

Can you review and tell me if this is correct? Do we need to initialize for the tests or is the new code in dsm_parse wrong?

@dagar The logic was that a Spektrum decoder could decode a partial packet first, then increase the channel count when the decoder hit the 2nd part. I'm not sure if that's generally correct or not. What we do know is that this could cause major crashes since it was unbounded and not initialised.

The change looks wrong to me and this does fix it. The change was wrong because we had that logic already:
		/* update the decoded channel count */
		if (channel >= *num_values) {
			*num_values = channel + 1;
		}


Properly zero-initialise objects

Rather than trying to cheat compiler into forcefully zeroing memory, like https://github.com/GPUOpen-LibrariesAndSDKs/Anvil/pull/128 tries to do, properly zero-initialise the relevant objects.
Fixes #125
Closes #128

I don't like memsetting structs you propose in the PR, since this assumes NONE enums are always 0, which is true right now but may change in the future. However, the good find here is that the affected structs were missing default constructors, so thanks for contributing. I've added these internally.
Also, we should not be modifying external dependency's source code, as such changes would be overwritten when we update the dependency to newer version.

The same problem is being "fixed" in https://github.com/GPUOpen-LibrariesAndSDKs/Anvil/pull/144/

Since GCC 8 compiles and GCC 8 hates memsets (?does it in order to have a more aggressive optimization?) we can say that were the lasts memsets in the repo


Feature Request: Sort selected items in DropDown multiple selection

Is your feature request related to a problem? Please describe.
Our users find it confusing when selected items are still on the bottom of the list when opening the DropDown.
Describe the solution you'd like
A property where we can apply sorting on ID or something else.
Describe alternatives you've considered
Sorting the list ourselves when DropDown is opened with the List<T>.Sort method.
Additional context
None.

Most probably we will not add such feature, I haven't seen any DropDown component in any platform where selected items are sorted on the top of all items. You might need to create a custom DropDown component similar to these demos or to try to sort the collection bound to the DropDown Data property on every selection change.


Windows ci

Codecov Report

Merging #81 (3cb15ba) into main (1a5ce54) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #81   +/-   ##
=======================================
  Coverage   80.95%   80.95%
=======================================
  Files          24       24
  Lines         966      966
  Branches      166      166
=======================================
  Hits          782      782
  Misses        133      133
  Partials       51       51

Flag
Coverage Δ

unittests
80.95% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

How does this CI test actually work?  I see that you download the rp2040 Micropython but where are you installing it?

I'll add some formal documentation at some point, but here are the important bits for testing (all commands start at the root of this project):
First, install this repo:
poetry install

to run unit tests:
poetry run python -m pytest

to install integration test dependencies (this uses a rp2040js pi pico emulator):
git clone https://github.com/wokwi/rp2040js.git
cd rp2040js
npm install
wget https://micropython.org/resources/firmware/rp2-pico-20210902-v1.17.uf2
cd ..

to run the integration tests (tests launch and interact with rp2040js pi pico emulator, a bit slower, but very close to actual usage):
poetry run python -m pytest tests/integration


Please update this page to add pre-req @ Azure DevOps Organization level

Hi, as pointed out in #7231 by @dan-mill / @WilliamAntonRohm please add a section about organization pre-reqs , enable OAuth in Policy section of the Azure DevOps Organisation. Not having this lead to frustration in my Team @ T-Systems. Thanks to @WilliamAntonRohm giving to Right hint.
Thanks, Thomas

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 1cddc0ae-93af-297c-2e71-334143ebee1e
Version Independent ID: cb76e516-8471-c3e1-45f4-0a20a223f32a
Content: Create a service hook Microsoft Teams - Azure DevOps Services, TFS 2017
Content Source: docs/service-hooks/services/teams.md
Product: devops
Technology: devops-collab
GitHub Login: @mijacobs
Microsoft Alias: mijacobs

Hi @nocheinlarry, Thanks for this feedback. I've created a PR for this issue. Once the PR is published, this issue will automatically be closed. Please @mention me if you have any further questions. Thanks again!


Support building without flake.nix

Also support building without Nix Flakes (again) using
nix-build -A system -A config.system.build.tarball ./nixos.nix

I guess that counts as serial contributor now. Thank you :pray:


"shift+command+[" cannot be recognized by Mac

Does this issue occur when all extensions are disabled?: Yes

VS Code Version: 1.62.1
OS Version: macOS 12.0.1  - MacBook Pro（14inch, 2021）

Steps to Reproduce:

Nothing. It occurs in the default keyboard shortcut settings.

My investigations are below.

The inputs of "shift+command+[" is recognized by macOS, but VSCode recognizes as "shift+command" only. (The logs in the Keyboard Shortcuts Troubleshooting window are pasted below.)
"shift+command+[" shortcut is not overwrapped in Visual Studio Code.
Keyboard dispatch is set as "KeyCode", it cannot resolve this problem.
Even if all extensions are disabled, this problem occurs.
The other "shift+command+[" is not found in macOS settings.

The logs in Keyboard Shortcuts Troubleshooting window.
# Try "shift+command+]" => recognized
[2021-11-11 15:20:34.941] [renderer1] [info] [KeybindingService]: / Received  keydown event - modifiers: [shift,meta], code: MetaLeft, keyCode: 91, key: Meta
[2021-11-11 15:20:34.943] [renderer1] [info] [KeybindingService]: | Converted keydown event - modifiers: [shift,meta], code: MetaLeft, keyCode: 57 ('Meta')
[2021-11-11 15:20:34.943] [renderer1] [info] [KeybindingService]: \ Keyboard event cannot be dispatched in keydown phase.
[2021-11-11 15:20:35.049] [renderer1] [info] [KeybindingService]: / Received  keydown event - modifiers: [shift,meta], code: BracketRight, keyCode: 221, key: ]
[2021-11-11 15:20:35.050] [renderer1] [info] [KeybindingService]: | Converted keydown event - modifiers: [shift,meta], code: BracketRight, keyCode: 89 (']')
[2021-11-11 15:20:35.050] [renderer1] [info] [KeybindingService]: | Resolving shift+meta+[BracketRight]
[2021-11-11 15:20:35.050] [renderer1] [info] [KeybindingService]: \ From 2 keybinding entries, matched workbench.action.nextEditor, when: no when condition, source: built-in.
[2021-11-11 15:20:35.208] [renderer1] [info] [KeybindingService]: + Ignoring single modifier meta due to it being pressed together with other keys.

# Try only "["
[2021-11-11 15:20:37.801] [renderer1] [info] [KeybindingService]: / Received  keydown event - modifiers: [], code: BracketLeft, keyCode: 219, key: [
[2021-11-11 15:20:37.802] [renderer1] [info] [KeybindingService]: | Converted keydown event - modifiers: [], code: BracketLeft, keyCode: 87 ('[')
[2021-11-11 15:20:37.802] [renderer1] [info] [KeybindingService]: | Resolving [BracketLeft]
[2021-11-11 15:20:37.803] [renderer1] [info] [KeybindingService]: \ No keybinding entries.

# Try "shift+command+["
[2021-11-11 15:20:39.648] [renderer1] [info] [KeybindingService]: / Received  keydown event - modifiers: [shift], code: ShiftLeft, keyCode: 16, key: Shift
[2021-11-11 15:20:39.649] [renderer1] [info] [KeybindingService]: | Converted keydown event - modifiers: [shift], code: ShiftLeft, keyCode: 4 ('Shift')
[2021-11-11 15:20:39.649] [renderer1] [info] [KeybindingService]: \ Keyboard event cannot be dispatched in keydown phase.
[2021-11-11 15:20:39.705] [renderer1] [info] [KeybindingService]: / Received  keydown event - modifiers: [shift,meta], code: MetaLeft, keyCode: 91, key: Meta
[2021-11-11 15:20:39.707] [renderer1] [info] [KeybindingService]: | Converted keydown event - modifiers: [shift,meta], code: MetaLeft, keyCode: 57 ('Meta')
[2021-11-11 15:20:39.707] [renderer1] [info] [KeybindingService]: \ Keyboard event cannot be dispatched in keydown phase.

The following gif shows that open previousEditor does not work though "shift + command + open_bracket" are pressed.

@shirakiya This indicates that VS Code does not receive the keypress shift+command+[ from the OS. There is nothing we can do on our side if the OS does not send us the keybinding. I have seen many reports in the past of similar issues, and they are always one of the following:

the OS is configured to do something on this keybinding and therefore intercepts and "steals" it from all applications. You can try looking in detail at the OS settings around keyboard shortcuts.
there is another application installed on the machine which is intercepting and "stealing" this particular keybinding.

I see what you mean, thanks to the quick response. Do you know of a good way to tell which other apps are stealing this shortcut?

I'm sorry, I didn't read carefully that the keybinding works in other apps. Could you please try the following:

Download and open https://www.electronjs.org/fiddle for you platform
Load https://gist.github.com/deepak1556/69b8930b819f82115df50d0f466dd1ba via Load Fiddle button on the top right corner
Choose Electron version v13.5.2 from top left dropdown
Run the app
With the input box focused, press shift+command+[
Take Screenshot

It would look something like this:

@alexdima Don't worry. When I did the step 2, this error message was shown x(

Here is the fiddle content. You can paste the following in main.js:
// Modules to control application life and create native browser window
const {app, BrowserWindow} = require('electron')
const path = require('path')

function createWindow () {
  // Create the browser window.
  const mainWindow = new BrowserWindow({
    width: 800,
    height: 600,
    webPreferences: {
      sandbox: true
    }
  })

  // and load the index.html of the app.
  mainWindow.loadURL('https://w3c.github.io/uievents/tools/key-event-viewer.html')

  // Open the DevTools.
  // mainWindow.webContents.openDevTools()
}

// This method will be called when Electron has finished
// initialization and is ready to create browser windows.
// Some APIs can only be used after this event occurs.
app.whenReady().then(() => {
  createWindow()

  app.on('activate', function () {
    // On macOS it's common to re-create a window in the app when the
    // dock icon is clicked and there are no other windows open.
    if (BrowserWindow.getAllWindows().length === 0) createWindow()
  })
})

// Quit when all windows are closed, except on macOS. There, it's common
// for applications and their menu bar to stay active until the user quits
// explicitly with Cmd + Q.
app.on('window-all-closed', function () {
  if (process.platform !== 'darwin') app.quit()
})

// In this file you can include the rest of your app's specific main process
// code. You can also put them in separate files and require them here.

I succeeded to take a screenshot, here you are. I tried "shift+command+[" in two times.

@shirakiya Thank you for trying. This proves that all Electron applications do not receive this keybinding on your machine (not just VS Code).
Could you please also try using Chrome and opening https://w3c.github.io/uievents/tools/key-event-viewer.html . Is Chrome able to receive the keybinding?

1~4 are the group of first try and 5~8 are the group of the second try.

@shirakiya Thank you for trying. This shows that all Chromium based apps do not get this keybinding on your machine (not just Electron applications, not just VS Code).
You could also try https://w3c.github.io/uievents/tools/key-event-viewer.html in Safari or in Firefox to see if those applications get the keybinding or not.

Safari
Try in two times. "shift+command+[" works in Safari.

The following screenshot shows that I also tried "shift+command+]".

Firefox
BracketLeft appeared!

For your information, this "shift+command+[" shortcut works in macOS 11.6 (MacBook Pro 13-inch 2016) with VSCode 1.62.1 and the same settings.  macOS Monterey may be doing bad.

I've had same problem with macOS Big Sur and Monterey. Not only VSCode but Electron apps didn't receive "cmd [" combination.
I fixed this with 3 times of Macintosh HD format and 3 times of macOS reinstallation. (Even if no other apps or extensions is in my Mac, I encountered this issue 2 times).
I don't know the reason why I could fix this but I can suggest the following steps.

Update the macOS to latest version.
Shutdown and boot with "cmd R".
reinstall macOS. (macOS reinstallation don't erase your data. Format Macintosh HD if you want to erase yours.)

I realized the input "shift+command+fn+[" works like "shift+command+[" shortcut.

@shirakiya Looking again at the screenshots you have from Safari I think both shift+command+] and shift+command+[ do not work in Safari. That is because they are browser shortcuts to move focus to the next tab/previous tab. But I can see from the Firefox screenshot that shift+command+[ worked in Firefox. I honestly don't know why we would not receive the keybinding on your machine, but I can only believe it is an OS configuration problem. I will close this issue because there is nothing we can do on our side to improve things.


Local instance alignment for Java 9+ / debug mode

as IntelliJ is suggesting:
6-8: -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=14502
> 9: -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=*:15502
it must be considered when customizing local instance files

done in #587 by @mierzwid


Sometimes active trades list are not updated after position is opened, updated or closed

the trading activity should update automatically, it would be great to even show a pending trade the sec the user closes the pop up
please contact me and discuss this with me

the trading activity should update automatically
Speculations of why data may not be updated automatically:

frontend doesn't receive last block information from node
frontend block watcher may disconnect if window is left without activity for too long
frontend disconnected from node because of internet connection and failed to reconnect to block watcher
node itself dropped connection for frontend and frontend failed to reconnect to block watcher

it would be great to even show a pending trade the sec the user closes the pop up
This part should be ignored in this task and new task as feature request should be created to discuss it

Tested this on latest swap page - pending transaction appears (and disappears once confirmed) correctly, but the confirmed tx doesn't show in swap history till page is refreshed - we should check that swap history is being re-fetched periodically, or if this is already happening then we should make sure the tx is not being de-duplicated because of pending tx

I looked at Swap page and the reason why the history table is not automatically refreshed is pretty simple - we fetch the history transactions in an useEffect that is fired only on account change (= only after refresh).
The solution, however, is not so simple. I added a callback after successful transactions and changed the key on onGoingTransactions because of the possible clash. This should be sufficient but I found out that we don't have the data immediately after a transaction is successful, so the history table data fetch returns the same array of items. The problem is, our backend endpoint (${url}/events/conversion-swap/${account}) doesn't have the data right away. When I tried it to call the callback with setTimeout, it returned the correct items but it's not a good solution for multiple reasons:

We don't know how much delay we need so this is just an estimate.
We would show our users a table without the newest items and then it would suddenly refresh (it feels buggy).
Usage of setTimeout is not a good practice.

Any suggestions @creed-victor or @pietro-maximoff ?

It's possible to use useBlockSync - it returns block number dapp detected that account had confirmed transaction.
Ofc it will not help because we don't have data in the backend immediately - maybe it would make sense to have interval only for the next 5 minutes after useBlockSync changed.

It's possible to use useBlockSync - it returns block number dapp detected that account had confirmed transaction.
Ofc it will not help because we don't have data in the backend immediately - maybe it would make sense to have interval only for the next 5 minutes after useBlockSync changed.

Thanks for the idea, I will take a look at it :)


IVR move month validation

move month validation for states 5A/B and 12A/B to a function and provide comments

good testing for new function to be added

@gsvr please review

@gsvr 2nd pass plz

to implement the new make_month_choices utils function in all month choice states
&
refactor month validation logic

@gsvr please have a look & let's discuss whether two reworked functions need to be merged into one

@gsvr review plz

:+1:


Missing parameters on

Thank you for reporting an issue or suggesting an enhancement. We appreciate your feedback - to help the team to understand your needs, please complete the below template to ensure we have the necessary details to assist you. If you have a actual question, we would ask you to use PnP Yammer group at http://aka.ms/OfficeDevPnPYammer. Thanks!
Which PnP repository to report the issue?

PnP Sites Core - https://github.com/OfficeDev/PnP-Sites-Core

You can delete this section after you have confirmed target repository for your submission.
Category
[ ] Bug
[ ] Enhancement
Environment
[ ] Office 365 / SharePoint Online
[ ] SharePoint 2016
[V ] SharePoint 2013
In pnp-PowerShell it is possible to add parameters to the function ApplyProvisioningTemplate. Is this also possible with pnp core csom?
Here is an example of the pnp-Powershell function:
Apply-SPOProvisioningTemplate -Path "Template.xml" -Parameters<EMAIL_ADDRESS>Here is an example of my pnp core csom:
XMLTemplateProvider provider = new XMLFileSystemTemplateProvider(String.Format(@"{0}\Templates\", AppDomain.CurrentDomain.BaseDirectory), "");

            if (provider != null)
            {
                var template = provider.GetTemplate("PeriodeTemplate.xml");

                if (template != null)
                {
                    newWeb.ApplyProvisioningTemplate(template);

                    return true;
                }
            }

Yes, that's very possible:
var template = provider.GetTemplate("PeriodeTemplate.xml");
template.Parameters.Add("SiteOwnerEmail","someone@example.com");

Thanks it works!


Repo overhaul

Hey!
Could somebody basically overhaul the whole repo? Currently as an example the readme file says this is an test repo.
Incorporating Github CI would also be good!
I can do that if you want, you can add me push permissions :3
jh-devv

Absolutely not

Absolutely not

? Couldn't the README thing be good?
(About the write permissions, I just said I can help if needed :3 )

I do hope you realise that asking for write permissions on a repo out of nowhere is incredibly creepy. If you want to contribute, pull requests exist

I do hope you realise that asking for write permissions on a repo out of nowhere is incredibly creepy. If you want to contribute, pull requests exist

Yep, I know. I'm sorry about that but I can still help :3

@suchmememanyskill But hey! Again I'm sorry about the permissions thing. If you could "forgive" me it would be cool. I just wanted to help (maybe bit too fast).
But I really like your projects, this has made my "steam deck experience" hell'a lot better :3

@suchmememanyskill You can remove this issue if you want?


TIMERPROC fix unnamed parameters

The proper parameter names are missing. Technically the function prototype in windows.h is missing these names (typedef VOID (CALLBACK* TIMERPROC)(HWND, UINT, UINT_PTR, DWORD);), but you can tell from SetTimer what they're supposed to be (https://docs.microsoft.com/en-us/windows/win32/api/winuser/nf-winuser-settimer). Note the naming distinction though between dwTime vs uElapse, since dwTime here is the current time since system startup, as opposed to SetTimer uElapse which is the timer interval.

@fdwr : Thanks for your contribution! The author(s) have been notified to review your proposed change.


*Defnition:
Treatment involving the use of rapeseed meal as an organic fertilizer. Rapeseed meal is a by product of rapeseed oil production and has a high protein content.

Prefer the name "rapeseed meal exposure" as it better reflects the definition.
Proposed name and def'n:
id: PECO:0001068
name: rapeseed meal exposure
def: "A natural fertilizer exposure (PECO:0007087) which is the application of rapeseed meal." []
comment: Rapeseed meal is a by-product of oil production from seeds of the Rapeseed (Brassica napus L.) plant and has a high protein content.
synonym: "rape cake exposure (narrow)" NARROW []
synonym: "rapeseed cake exposure (narrow)" NARROW []

Thanks, agree with adding exposure and the improved definition.


N46: RustyJam3

Part of #1378

I've rewritten the section closer to how we usually announce jam results. Hope you're ok with my tweaks - feel free to ping me here if you think that something needs to be changed. :)


Feature: Add "image" column

Add a Image column type to tables.

Notes for mainters: I used type hinting whenever possible although they were not used in the rest of the code. Please feel free to review the codestyle about that and about one line "if" :)
An assets regeneration is needed to have the bg-cover class from Tailwind.

Usage:
Image::make($name)
    ->width($value) // Set the image width. Can be both a number (used as "pixel") or a string, like "2rem".
    ->height($value) // Set the image height. Can be both a number (used as "pixel") or a string, like "2rem".
    ->square($value) // Shortcut to set both width and height to the given value.
    ->class($class) // Additional classes for the image.
    ->rounded() // Show the image with rounded borders.
    ->cover(); // Resize the background image to cover the entire container. Useful to display non-squared images as squares.

Example:
Image::make('picture')
    ->square(64)
    ->rounded()
    ->cover();

Output:

Alomaisi

 of

Thanks! I ended up removing the cover() option and setting a default height. I also added an option to set the disk that the files should be read from, similar to FileUpload.

Thanks! I ended up removing the cover() option and setting a default height. I also added an option to set the disk that the files should be read from, similar to FileUpload.
The FileUpload component has an option to autocrop to 1:1 aspect ratio if you're looking for square image uploads 👍

Thank you @danharrin !
I'm not 100% sure about the disk: can I bypass it? I.e. can I show an image from an external URL?

Thanks! I ended up removing the cover() option and setting a default height. I also added an option to set the disk that the files should be read from, similar to FileUpload.
The FileUpload component has an option to autocrop to 1:1 aspect ratio if you're looking for square image uploads 👍

Thank you @danharrin !
I'm not 100% sure about the disk: can I bypass it? I.e. can I show an image from an external URL?

It uses Storage::url() under the hood which will respect external URLs if they are configured on your disk correctly - i.e. s3 URLs that are already fully qualified when they are saved. As for external URLs that reside outside of the storage disk, maybe we should check for a valid URL before passing through Storage::url()?

It uses Storage::url() under the hood which will respect external URLs if they are configured on your disk correctly - i.e. s3 URLs that are already fully qualified when they are saved. As for external URLs that reside outside of the storage disk, maybe we should check for a valid URL before passing through Storage::url()?

I think we should do the check, I just tried running Storage::url('https://www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png') and the result is "/storage/https://www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png" 🤔
Maybe filter_var is enough for the check:
var_dump(filter_var('https://www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png', FILTER_VALIDATE_URL)); // string
var_dump(filter_var('/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png', FILTER_VALIDATE_URL)); // false

#117


HADOOP-16372. Fix typo in DFSUtil getHttpPolicy method

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

0
reexec
75
Docker mode activated.

_ Prechecks _

+1
dupname
0
No case conflicting files found.

+1
@author
0
The patch does not contain any @author tags.

-1
test4tests
0
The patch doesn't appear to include any new or modified tests.  Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ trunk Compile Tests _

+1
mvninstall
1098
trunk passed

+1
compile
59
trunk passed

+1
checkstyle
42
trunk passed

+1
mvnsite
67
trunk passed

+1
shadedclient
828
branch has no errors when building and testing our client artifacts.

+1
javadoc
51
trunk passed

0
spotbugs
167
Used deprecated FindBugs config; considering switching to SpotBugs.

+1
findbugs
164
trunk passed

_ Patch Compile Tests _

+1
mvninstall
60
the patch passed

+1
compile
56
the patch passed

+1
javac
56
the patch passed

+1
checkstyle
39
the patch passed

+1
mvnsite
61
the patch passed

+1
whitespace
0
The patch has no whitespace issues.

+1
shadedclient
775
patch has no errors when building and testing our client artifacts.

+1
javadoc
49
the patch passed

+1
findbugs
170
the patch passed

_ Other Tests _

-1
unit
6086
hadoop-hdfs in the patch failed.

+1
asflicense
35
The patch does not generate ASF License warnings.

9791

Reason
Tests

Failed junit tests
hadoop.hdfs.server.balancer.TestBalancer

Subsystem
Report/Notes

Docker
Client=18.09.5 Server=18.09.5 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-967/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/967

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle

uname
Linux e9ad87674e76 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3 08:28:49 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
personality/hadoop.sh

git revision
trunk / 4f45529

Default Java
1.8.0_212

unit
https://builds.apache.org/job/hadoop-multibranch/job/PR-967/1/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt

Test Results
https://builds.apache.org/job/hadoop-multibranch/job/PR-967/1/testReport/

Max. process+thread count
2899 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-967/1/console

versions
git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1

Powered by
Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.


Typing issue: 礦坑, 砿坑

Category of the typing issue
Choose one of them (delete rest of them)

Out-of-vocabulary (e.g. "夕日" is not in the candidate list at all).

Issues
Write issues to the following table. (It's in the markdown format)

input [e.g.ゆうひ]
expected [e.g. 夕日]
actual [e.g. ユウヒ]

こうこう
礦坑
(optional, write here)

こうこう
砿坑
(optional, write here)

Version or commit-id
Mozc-2.30.5490.102+24.11.oss
Additional context
Add any other context about the problem here.

[!NOTE]
Typing issues will be closed when the entries are added to test cases and
evaluations.
https://github.com/google/mozc/blob/master/src/data/test/quality_regression_test/oss.tsv
https://github.com/google/mozc/blob/master/src/data/dictionary_oss/evaluation.tsv

https://www.google.com/search?client=firefox-b-d&q=砿坑
You should add more context including the difference from "鉱坑".


Allow building with directory-<IP_ADDRESS>

GHC 8.0.2 ships with directory-<IP_ADDRESS>, for which unix-compat's upper version bounds (< 1.3) are too tight. The only API-breaking change in directory-<IP_ADDRESS> involves canonicalizePath, which unix-compat doesn't use, so this bound can be relaxed.

I have published a new revision for <IP_ADDRESS> which widens the bounds for directory.
Merging this so there isn't a regression. 👍


Send filtered memory to agent

When building agent, also set its memory.
memory needs to be filtered to relevant messages.

assistant: only its own output
user: the rewritten user prompts

how to include output of other agents, without affecting quality?

could add prefix to assistant messages, with agent id


Issues in Jruby on Android (Ruboto)

Attempt to load readline raises  ArgumentError.
Current line is printed on remote stdout instead of rdebug --client stdout.

This change is related to: rocky/linecache#4
Depends upon linecache-1.3.1.

I see I missed the 0.10.6 release :-( . Is there any chance of a 0.10.7 patch release in the near future ?
These changes for Ruboto compatibility would greatly help me simplify a debugging tutorial in progress there.
Thanks
-gf-


mixin: Fix broken Jsonnet builds

This PR updates jsonnet-bundler to the latest master version to fix broken builds.
Signed-off-by: Kemal Akkoyun<EMAIL_ADDRESS>
[ ] I added CHANGELOG entry for this change.
[ ] Change is not relevant to the end user.

Changes

Update jsonnet-bundler to the latest master.
Update Makefile to prevent issues introduced with latest version of jsonnet-bundler

Verification

make jsonnet-vendor
make examples

cc @brancz @metalmatze

The failure is not related, I guess it's a flaky one, someone needs to re-run the CI job.


Make connection points for connected equipment routes aligned to icon

As a CoMPAS user
I want to see the routes connected to equipments be more aligned to the icons
So it looks more smooth and 'connected'.
Example:

Here, the route on the left should be underneath the icon to make it look more connected.

I have already dealt with this "issue" in this PR. I just changed the getDirection so that is leaves ConductingEquipment and PowerTransformer vertically and ConnectivityNode is the one that can be reached horizontally and vertically.

@JakobVogelsang sounds good!
Is it an idea to make this dependently on the sxy:dir attribute in the SCL? (ConductingEquipment and PowerTransformer only)


Don't ignore render index node's icon parameter

Bug/issue #, if applicable:
Summary
This fixes a potential bug where the RenderIndex.Node initializer always ignored the icon parameter
Dependencies
None
Testing
Describe how a reviewer can test the functionality of your PR. Provide test content to test with if
applicable.
Checklist
Make sure you check off the following items. If they cannot be completed, provide a reason.

[ ] Added tests
[x] Ran the ./bin/test script and it succeeded
[ ] Updated documentation if necessary

@swift-ci please test


Remove unused hybrid.css, rename code style theme file

There were two css files present containing themes for code styles:

static/css/hybrid.css
static/css/atom-one-dark-reasonable.css (actively used)

In this PR I:

removed the unused hybrid.css
removed references to hybrid.css
renamed the css file to the more reasonable code-style-theme.css

From a CSS point of view hybrid.css is still loaded but its styles may be overwritten by atom-one-dark-reasonable.css. I am not quite sure if the later will redefine all of the previous styles.
Nevertheless, I think it's not a good idea to load two highlight.js styles in one html file. So deleting hybrid.css and all its references may be a good idea (it's also still in use in the `404.html')
The files shouldn't be renamed, because that's their official name in the official hightlight.js repo and therefore would hide their origin.


[SG-235] feat: integrate token factory

Closes: #700
Bringing in the Osmosis token factory to Stargaze.

Hey, I will ask @larry0x if this is a good implementation.  Scary piece about the token factory is that there are so many versions.  @Reecepbcups did a pretty nice one for Juno though and I'm going to promote it.

Hey, I will ask @larry0x if this is a good implementation. Scary piece about the token factory is that there are so many versions. @Reecepbcups did a pretty nice one for Juno though and I'm going to promote it.

This PR seems to be simply copy-pasting code in the Osmosis repo over. This is probably the better solution over importing Confio or Juno's fork imo, because when Osmosis finally spins off their module into a separate repo you can simply delete the code copied over and import that repo instead. If using a forked version I'd be worried about incompatibilities.
A few suggestions:

I recently made a contribution to Osmosis introducing a "denom creation gas consume" feature. The rationale for using this over the "denom creation fee" is discussed here. Do you mind including this in your PR as well?

I think you need an upgrade handler to initialize the module's parameters. See here for an example.

This PR doesn't seem to include any wasm bindings. In this case, can you enable Stargate queries so that contracts can interact with the module? See here for an example.

I'm happy to PRs on these if you prefer (i.e. I will make PRs targeting your branch)

Thanks for the feedback on the PR @larry0x

Will check out the "denom creation gas consume" feature as Stargaze is implementing globalfees with the upcoming release (v10) as well.
Upgrade handler has intentionally not been implemented yet as token factory is planned for v11 (so upgrade after the next upgrade).
Had missed the Stargate queries enabling. Thanks for the catch 👍🏻

seems we're on the same page on most of this.
Thanks very much for your review Larry.
to my knowledge no one knows exactly what to do about token factory.  Maybe I should open an issue on osmo and try to get juno changes upstreamed.
I think both osmo and juno hoped to have it in wasmd as a first class citizen, and we (notional) maintain this thing:
https://github.com/notional-labs/wasmd/releases/tag/v0.40.0-tf.rc4
but tbh the more I think about it the more it feels like some sort of monstrosity.
I like the modularity idea, however, there's just not a canonical source. @Reecepbcups tried to make one (valiant effort) github.com/cosmostokenfactory -- but then there were maintenance issues wrt juno.
Tbh I am mildly out of ideas.

I think both osmo and juno hoped to have it in wasmd as a first class citizen

I think it doesn't necessarily need to be in wasmd, but definitely has to be a separate repo
Sunny seems to want it upstreamed to cosmos-sdk repo, which would take muuuuuch longer to happen
Please push for the spin off to happen Jacob

@larry0x -- spinoff happened and was cancelled, imo for good reason.  I like this idea of putting it in cosmos-sdk tbh.  A lot.  I would need to see if I can muster the troops to refactor it tho.


L1A darks that are missing binning data in primary header

https://www.dropbox.com/s/y0g2mmlxspe9vql/no_binning_data_in_header.txt?dl=0
Reported to Chris on 2015-06-16

Resolved by being as intended for non-linear binning.


Release 22.1.0 planning

We've made a lot of improvements, so I'd like to make a release soon so we can start using them in typeshed.
I can make the actual release, but here's what I'd like to do first:

Set up automation (#114)
Organize the changelog a bit better

Let me know if there's something else you'd like to go in first! In the future, we should be able to make releases basically whenever we have something we'd like to go out.

Concrete plan: I'll cut a release this Sunday, January 23, unless somebody tells me otherwise.

Last chance if you want something in :). I'll make an RC release first and make sure it works with typeshed.

Release 22.1.0 is now published.

https://pypi.org/project/flake8-pyi/22.1.0/

typeshed updated in python/typeshed#7004.


raise Type Error

Dear Martin,
First thanks for your great work.
I ran the code, but there is an error I don't know how to deal with.
The error is :
raise TypeError('Invalid number of arguments passed to legend. '
TypeError: Invalid number of arguments passed to legend. Please specify either 0 args, 2 args (artist handles, figure labels) or 3 args (artist handles, figure labels, legend location)
Could you help me , thank you very much!
I'm looking forward to your reply.

I think you have to update your matplotlib Python package. The code was tested with matplotlib 2.2.3

Thank you so much!