Documentation of a function capture_file()?

Hey folks,
I dig into the code in picamera2.py to see, what arguments I can pass to capture_file(). From source code it seems that, you can
pass these arguments without any problem. But in my case there is no image, which is saved.
def capture_file(
            self,
            file_output,
            name: str = "main",
            format=None,
            wait=None,
            signal_function=None) -> dict:

I used this function for my purpose like this:
filename =  time.strftime("%Y%m%d-%H%M%S") + '.png'
output = '/home/pk/Pictures'
cam.capture_file(output, filename, wait=False)

# OR

filename = dirname + "_" + str(imgnum) + '.png'
savepath = os.path.join(dirpath, filename)
cam.capture_file(savepath, format='png', wait=False)

Why nothing of this cases is working? The only way it's shown in examples is using capture_file(path/to/image/test.png)

Hi, your first example doesn't work because the first (required) parameter must be a file name, and the second would be the name of the stream ("main", "lores" or "raw", defaulting to "main").
The second example works for me - can you say how it is failing?

Why it's not like the handled arguments in the definition of this function?
With your changed suggestions it prints, that the picture is taken, but there's no picture taken and saved (default location: maybe /home/username). The same with the second example, which works for you.
cam.capture_file(filename, "main", format='png', wait=False)
cam.capture_file(savepath, format='png', wait=False)

The second examples don't contain the filename, just the save path, which includes the filename. So did you change anyhing else? How can I o. it's possible to set the save location?
To prevent misunderstandings I'm using this:
def getkey():
    fd = sys.stdin.fileno()
    old_settings = termios.tcgetattr(fd)
    try:
        tty.setraw(fd)
        ch = sys.stdin.read(1)
    finally:
        termios.tcsetattr(fd, termios.TCSADRAIN, old_settings)
    return ch

dirname = 'home/pk/Pictures/'
cwd = os.getcwd()
dirpath = os.path.join(cwd,dirname)

cam = Picamera2()
time.sleep(1)

try:
    while True:
        key = getkey()
        if key == 'p':
            filename =  time.strftime("%Y%m%d-%H%M%S") + '.png'
            savepath = os.path.join(dirpath, filename)
            cam.capture_file(savepath, format='png', wait=False)
            #cam.capture_file(filename, "main", format='png', wait=False)
            print(f"Captured {filename} succesfully")
        elif key == 'q':
            print("Closing camera...")
            break
finally:
    cam.close()

Hi, could you maybe try the following and report whether it works:
from picamera2 import Picamera2
cam = Picamera2()
cam.start()
cam.capture_file("test.png", format='png')

(As I said somewhere else, I wouldn't use wait=False.)
I'm afraid I couldn't quite understand exactly what else was not working as you expected. If you could include a minimal test case (as I have above), report exactly how it behaves incorrectly, along with any error messages, that would be very helpful. Thank you!

Hey,
it works fine, can you link the issue where you spoke about the use of wait=False.
My intention was to save my file to a specific folder with a specific filename, the WRONG listing of handling parameters in the fucntion cam.capture_file has prevented that without any warning or error message. Was just a pure logic error.
I would like to share my example script through a pull request, so other don't struggle to find exmaples like mine.

Hey, it works fine, can you link the issue where you spoke about the use of wait=False.

I mentioned it here.

My intention was to save my file to a specific folder with a specific filename, the WRONG listing of handling parameters in the fucntion cam.capture_file has prevented that without any warning or error message. Was just a pure logic error.

I'm afraid I still haven't really understood what was handled incorrectly or did not behave helpfully. Or is it that some documentation is incorrect? If you could include a tiny code snippet and just explain what happened vs what you expected then I would take a look. Thanks!

I would like to share my example script through a pull request, so other don't struggle to find exmaples like mine.

Yes, please do. Please check the contribution guidelines first.  I don't think there's anything too difficult there (especially if you're only adding an example), but we do have some small conventions about commit messages, sign-off, and which branch to make pull requests for. Thanks!

Thanks, thought it was a different issue not (https://github.com/raspberrypi/picamera2/issues/606#issuecomment-1458402671). I will change my current pull request then to your guidelines.
Back to the previous issue:
false code:
https://github.com/raspberrypi/picamera2/issues/608#issue-1615017474
expected behaviour: saving a .png image to the specified folder
happened: not saving anything, just printed in terminal, that a image has been saved
right code:
filename = "".join([dirname, "_", str(imgnum), ".png"])
savepath = os.path.join(dirpath, filename)
cam.capture_file(savepath,  "main", format="png", wait=None)

expected behaviour: saving a .png image to the specified folder
happened: with your hints here (https://github.com/raspberrypi/picamera2/issues/608#issuecomment-1459958263) it works.

In your code dirname has to be an absolute path, i.e. /home/pk/Pictures not home/pk/Pictures which depending on what is your current directory probably does not exist (unless it is /).


Event registration annotations reference i18n>Familienmitglieder

eventregistration-service-annotations.cds refers to i18n element Familienmitglieder. This element does not exist. Based upon i18n files, it should rather reference element Familymembers

Fixed by https://github.com/SAP-samples/ui5-cap-event-app/pull/3
Thanks for spotting this and sorry for the delay!


Sto step palettes v3 doc 3159

Harness Developer Pull Request
Thanks for helping us make the Developer Hub better. The PR will be looked at
by the maintainers.
What Type of PR is This?

[ ] Issue
[ ] Feature
[ ] Maintenance/Chore

If tied to an Issue, list the Issue(s) here:

Issue(s)

House Keeping
Some items to keep track of. Screen shots of changes are optional but would help the maintainers review quicker.

[ ] Tested Locally
[ ] Optional Screen Shoot.

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app

@douglas-j-bothwell do you still need this? GH marked this as stale.

@douglas-j-bothwell do you still need this PR? GH flagged it as stale.


The "core-context.owl" and "stix-core-context.owl" files need to be corrected after a bad search and replace edit.

In one or more find and replace processes the integrity of the core-context.owl and stix-core-context.owl files were affected.
In specific, a search for "http://docs.oasis-open.org/cti/ns/stix#http://docs.oasis-open.org/cti/ns/stix#" may identify the impacted files. I believe the problem exists in only two files:

core-context.owl
stix-core-context.owl

Removed all the current filename-context.owl files. These files have been deprecated for many months. They are not imported into the stix-spec.owl to avoid the logical inconsistencies they introduced.
Cardinality was constrained in some of the context files. We may wish to revisit cardinality constraints.


Base voice on contribution score

Specs
https://docs.google.com/document/d/1vg95Bw4Pzsqe4DXPusiyD2hAU-HCI-37c0AAZSXxC68/edit
Instead of giving every citizen fixed voice, we have to base voice on contribution score.
Check the constitution for the formula
Contribution score is a ranking from 0-99 which is in the harvest contract.
Deployment

[x] Pass all unit tests locally
[x] Deploy on proposals, harvest on testnet
[x] Run onperiod on funds on testnet
[x] Deploy on proposals, harvest on mainnet before Thu 7 pm CST (today)

Done


request: VGG19

now Chainer supports VGG19, so how about below two?

adding VGG19 to chainercv/links/model/vgg
adding its link to caffemodel to examples/vgg/caffe2npz.py

Please excuse my lack of explanation.
I meant classification task with VGG19.
That's why I ask adding caffemodel URL to examples and add (pickable) VGG19 to links.

Currently, we have no plan to add VGG19 classification model.
That is because of the classification score reproduction of original paper
Please feel free to add VGG19 classification model.


Make sure Emilio has access to up-to-date targets

Currently none of the results of this targets pipeline are committed to git.  If I move the whole (local) repo onto DropBox, Emilio can access all the targets without having to re-run the pipeline.  Not sure if I have to do anything special to get RStudio, git, and DropBox to work together though.

Maybe this isn't that important since I'll still be working on the code portion of this for the forseeable future


Update export

@PWKad I know you've got some PRs to get in. Can I merge this one? or is there duplicated/conflicting work?


Static build

Any plans to provide static build?
Haven't succeed to compile capybara-webkit yet, so I can't see binary yet.
Most probably it will have dependencies to some *.dylib files, it can be solved with
Can see example how I make portable libpq https://github.com/Paxa/postbird/blob/master/BUILDING_DEPS.md
Many gems provide precompiled binaries, e.g. nokogiri

This is something we've talked about, given that Qt has been a generally troublesome dependency. We've also considered switching to CEF, in which case we would need to provide a separate build.
Nobody has a ton of resources to spend on capybara-webkit right now, but the ability to use prebuilt binaries would be nice.


Windows 10 Mobile - double clicked number

Hello,
please I have following problem: When I click on number, for example 5, it write 55. Backspace works fine. Withou this plugin it works.
Thanks for help.

Can you try both 1.9.43 * version 2 and let me know the results.

Same behauvior

Find out the probblem probably.  Problem is, that the stopping dont work on WM. When I stop calling processKeypress function, it works like a charm (but it doesnt work on all other devices :D )

Hello @jirkae , since issue #292 has been fixed, input and change events are now correctly sent.
Could you please test again with the latest version found in the next branch?
Thanks!

Due to inactivity, I'm closing this issue considering it resolved.
If that's not the case, feel free to re-open it!


MAAS-3655 | Dont set num_instances to None

Don't set num_instances to None to avoid TypeError when comparing None to int.

Coverage remained the same at 91.43% when pulling 187dc93329cad88792100427f0cd5efc44cabf5d on MAAS-3655-set-default-for-num-instances-in-http-check into e43e35bf4118437b01471feb6a3ace97abdc7d3b on develop.


cmd-d should clear pending key combinations

c (going to type ciw)
(realize that I should actually need to change this word a few times)
cmd-d (select next occurrence of this word with a new cursor)
(does not enter Visual mode like normal)
c
(it triggers `cc` for each cursor)

Pressing cmd-d with stored keystrokes should clear them and enter visual mode like normal. I would expect pressing the second c to do a normal visual-mode change-in-word.

This is an interesting problem.  ctrl-shift-w, ctrl-shift-b, ctrl-shift-f, alt-shift-b, alt-shift-f, ctrl-shift-e, ctrl-shift-a are some of the other selection key combinations that should clear the stored keystrokes.
Also, c alt-b c fails.  It should move to the beginning of the word and resume changing.  Also alt-f, cmd-right, cmd-left, cmd-up, cmd-down, and just about any Atom navigation key.
also c cmd-j c, and all the sublime edit commands, like ctrl-T, alt-backspace, alt-delete, etc.
Maybe any non-vim-mode key needs to clear the stored keystrokes?

As stated in the README, this package is no longer maintained and is deprecated. We recommend that people use the vim-mode-plus package instead. Because of this, we are archiving this repository and closing all issues and pull requests. Thanks very much for your support and contributions!


Detect when the app has been idle for a bit and generate an account only if the user has used the app enough

(Or do this as a background task)

@marcelomorgado In the long run, I do think we want to detect when the app has been idle for a bit and generate an account only if the user has used the app enough. In the short run, it might show off our simple onboarding flow better if we had this happen behind the scenes while they were browsing land.
If you agree, let's make another issue for that.
Would the account generation step block the user from scrolling on the land screen as it works right now?

To clarify: Should we create a short-term issue to trigger the account set up on the app startup?
Not sure, I theory if we wrap the account creation process with an async function it should run in the background. But maybe it'll block the user during the 20segs of generation step (Account.create()), even that happens we can try some trick to solve that.

1a. Either that or make it manually triggerable from the My profile screen.
1b. Maybe we decouple account generation and funding too? Open to your creative input here.
1c. I wonder if all of the funding happening behind the scenes sets unreasonable expectations for the "real" flow we'll eventually use. Maybe not if the account is funded with some tokens used to pay for a few meta-tx, anyway. But having MANA may be unrealistic.

Okay yes, let's test specifically this before committing to having this happen on app startup. Triggering it on app startup shouldn't block the loading screen, and if it affects scrolling performance, etc. we wouldn't want to go that route.

1a. Makes sense;
1b, 1c. Since without expo-crypto, the account generation is spending about 20secs of waiting, sounds good to me decouple these steps and trigger the generation on the startup (if that not impacts the UX performance).
2. We can make some tryouts on that. As the first step, we can try to move the Account.create() from sign-up flow to start up.
Make sense?

1b, 1c. Okay, awesome. FYI on my iPhone X it's a little faster than that.

Okay. yep, let's try a tentative PR with just that change.

Sounds good. Thanks!


Extention browser

What problem does this PR solve?
Build chrome extensions that allow interaction with browser content

Please clean your commit history which includes commits of other contributors.
This could be used to clean your PR.

git pull --force upstream main:main

git push --force origin main:main

Backup your code firstly

I will move to new pull request


🔧 fix(treaty): Fix regex for replacing http(s) with ws(s)

I was reading through the source code and this regex looked like it was missing a :.

I tested your regex and seems like the outcome is the exact same. What benefits does it bring that are probably flying over my head? 🤔


[Gally]: master <- dev

Automatically created by Git-Ally

:tada: This PR is included in version 2.0.6 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Raise error if Preamble is given with viewgoods

As per intended usage in UG, viewgoods should only accept prefixed parameters or none at all.
Preamble should result in an error as documented, instead of silently returning the same effect as viewgoods.

LGTM


Sidebar tree css selector fix #126

Can you please rebase against master?

The fix does not work for sideebar with multi-level content.

You can test against: https://github.com/hossainemruz/toha-example-site

It fixes the sidebar however, it does not fix Table Of Contents.

Just add list-style: none; here: https://github.com/hossainemruz/toha/blob/6ae1b73852c534f97b59a0d3987f2fe2bfbfbab1/static/assets/css/layouts/single.css#L66

Thank you @dilekuzulmez. Looks good now. Really, appreciating your help.

Sure !


Enable pre-training by initializing new model with previously trained weights

@Josh-Joseph do you think this will be a quick task for the next issue to tackle? Perhaps on the command line for training we can give a new parameter like --pre-trained-weights <model_ID>, with default being no pre-training when the parameter is excluded. Then it just loads in this model and starts epoch 1 with that.

Branch: issue_32_init_pretrained_weigths
Modified train_segmetation_model.py:

added a new arg: model_id_start, default to none
if model_id_start not none (a pretrained model is used to initialize the weights):
- copy model locally
- compiled_model.weights_to_load = Path(local_model_dir, model_id_start, "model.hdf5").as_posix()

It runs, both with and without the model_id_start argument. Not sure if is doing the right thing yet.
Still need to modify the metadata file to say where the initial weights come from.

Added the pretrained model to the metadata file:
created_datetime: 20201019T164941Z
dataset_config:
  class_annotation_mapping:
    class_0_annotation_GVs: [100]
    class_1_annotation_GVs: [175]
    class_2_annotation_GVs: [250]
  dataset_split:
    test: [8bit_AS4_S2_P1_L6_2560_1750_2160]
    train: [THIN_REF_S2_P1_L3_2496_1563_2159]
    validation: [THIN_CNT_S2_P1_L4_2334_1578_2159]
  image_cropping:
    min_num_class_pos_px: {class_0_pos_px: 5, class_1_pos_px: 5, class_2_pos_px: 5}
    num_neg_per_class: 1
    num_per_image: None
    num_pos_per_class: 1
    type: class
  stack_downsampling: {num_skip_beg_slices: 50, num_skip_end_slices: 50, number_of_images: 100,
    type: linear}
  target_size: &id001 [512, 512]
elapsed_minutes: 8.6
gcp_bucket: gs://necstlab-sandbox
git_hash: 692429e0290544b2652339fb4e8e99050054e591
global_threshold_for_metrics: 0.5
num_classes: 3
original_config_filename: configs/config_sandbox/tf_version_debug//train-small-3class_tfversion_debug.yaml
**pre_trained_model_config:
  batch_size: 16
  data_augmentation: {random_90-degree_rotations: false}
  dataset_id: dataset-small-3class_tfversion_debug
  epochs: 10
  loss: cross_entropy
  model_id_prefix: segmentation-model-small-3class_tfversion_debug
  optimizer: adam
  segmentation_model:
    model_name: Unet
    model_parameters: {backbone_name: vgg16, encoder_weights: null}
  test_data_shuffle_seed: 123456
  training_data_shuffle_seed: 1234
  validation_data_shuffle_seed: 12345
pre_trained_model_id: segmentation-model-small-3class_tfversion_debug_20201016T164701Z**
target_size: *id001

If we train a model:
python3 train_segmentation_model.py --gcp-bucket gs://necstlab-sandbox --config-file configs/config_sandbox/tf_version_debug//train-small-3class_tfversion_debug.yaml
and then train a model starting with the first models pretrained weights:
python3 train_segmentation_model.py --gcp-bucket gs://necstlab-sandbox --config-file configs/config_sandbox/tf_version_debug//train-small-3class_tfversion_debug.yaml --pre-trained-model-id segmentation-model-small-3class_tfversion_debug_20201019T174848Z
This is what we get: - the second model continuous training with the loss of the previously trained model:

If we train two models from the first trained models:
python3 train_segmentation_model.py --gcp-bucket gs://necstlab-sandbox --config-file configs/config_sandbox/tf_version_debug//train-small-3class_tfversion_debug.yaml --pre-trained-model-id segmentation-model-small-3class_tfversion_debug_20201019T174848Z

we obtain very similar loss evolutions. The starting point is the same, evolution is very similar but not exactly the same. All the possible (known) source of randomness is eliminated,   training_data_shuffle_seed, validation_data_shuffle_seed and  test_data_shuffle_seed and random_90-degree_rotations:
train_config:
  model_id_prefix: 'segmentation-model-small-3class_tfversion_debug'
  dataset_id: 'dataset-small-3class_tfversion_debug'
  segmentation_model:
    model_name: 'Unet'
    model_parameters:
      backbone_name: 'vgg16'
      encoder_weights: Null   # Null (random initialization) or 'imagenet' (pre-training on ImageNet)
  loss: 'cross_entropy'
  optimizer: 'adam'
  batch_size: 16    # p100
  epochs: 10
  training_data_shuffle_seed: 1234
  validation_data_shuffle_seed: 12345
  test_data_shuffle_seed: 123456
  data_augmentation:
    random_90-degree_rotations: False

To test if the seeds are working or not, we set the shuffle to False in the train_segmentation_model.py:
    train_generator = ImagesAndMasksGenerator(
        Path(local_dataset_dir, train_config['dataset_id'], 'train').as_posix(),
        rescale=1. / 255,
        target_size=target_size,
        batch_size=batch_size,
        shuffle=False,
        random_rotation=train_config['data_augmentation']['random_90-degree_rotations'],
        seed=None if 'training_data_shuffle_seed' not in train_config else train_config['training_data_shuffle_seed'])

This would eliminate the source of randomness for sure. However, we still get slightly different loss evolutions when training 2 models with this configuration:
python3 train_segmentation_model.py --gcp-bucket gs://necstlab-sandbox --config-file configs/config_sandbox/tf_version_debug//train-small-3class_tfversion_debug.yaml --pre-trained-model-id segmentation-model-small-3class_tfversion_debug_20201019T174848Z

It is my understanding that this means that tensorflow/ damage segmentation models have some intrinsic source of randomness that we do not control. However, it does not seem significant

Josh's comment:
ah so I wonder if this is randomness then of the optimizer -- so we'd also need to make sure the optimizer is seeded. I don't think(?) you can do that directly from keras but you can set tensorflow's random seed https://www.tensorflow.org/api_docs/python/tf/random/set_seed (so this could be done before training starts)
https://machinelearningmastery.com/reproducible-results-neural-networks-keras/
Reed's comment:
also, try putting this at the very top of the train script
from numpy.random import seed
seed(1)
from tensorflow import set_random_seed
set_random_seed(2)

if that doesn't work, then i think we will also need to make the GPU solve in a deterministic way (no issue here if using CPU tho). so then last thing will be: https://machinelearningmastery.com/reproducible-results-neural-networks-keras/
i guess these seeded modules at the top of train script shouldn't conflict with those in the dataset generators which are instantiated

Even after seeding tensorflow.random, numpy.random and random , the results were slightly different.
We could obtain repeatable results running in CPU, which is deterministic.

Now we can obtain repeatable results and have confirmed that training from pretrained weights is working.
Now we'll see if the tf 2.1 and 2.3 results are the same:
upgrade software versions #75

the results with tf2.3 are also repeatable (using cpu) @rak5216 @Josh-Joseph


cdpath can't find directory which has space.

Describe the bug
Got error when use Vim open file which is located at directory that has space in directory name.
Error
处理 function gutentags#setup_gutentags[101]..<SNR>107_update_tags[42]..gutentags#chdir 时发生错误:
第    6 行:
E344: cdpath 中找不到目录 "/home/roach/Nutstore\ Files/我的坚果云"
E472: 命令执行失败
E344: cdpath 中找不到目录 "/home/roach/Nutstore\ Files/我的坚果云"

which means cdpath can't find directory "/home/roach/Nutstore\ Files/我的坚果云"
Share your setup

Manjaro Linux, VIM - Vi IMproved 8.2 (2019 Dec 12, compiled May  8 2020 23:37:13)
local/global 6.6.4-1
g:gutentags_cache_dir: ~/.cache/tags

Post the logs
mess:
处理 function <SNR>107_write_triggered_update_tags[3]..<SNR>107_update_tags[42]..gutentags#chdir 时发生错误:
第    6 行:
E344: cdpath 中找不到目录 "/home/roach/Nutstore\ Files/我的坚果云"
E472: 命令执行失败
gutentags: Wildignore options file is up to date.
gutentags: Running: ['/home/roach/.vim/plugged/vim-gutentags/plat/unix/update_tags.sh', '-e', 'ctags', '-t', '/home/roach/.cache/tags/home-roach-Nutstore_Files-我的坚果云-.tags', '-p', '/home
/roach/Nutstore Files/我的坚果云', '-s', '/home/roach/Nutstore Files/我的坚果云/.cheat/vim.plugin.ale', '-o', '/home/roach/.vim/plugged/vim-gutentags/res/ctags_recursive.options', '-O', '--fi
elds=+niazS', '-O', '--extra=+q', '-O', '--c++-kinds=+px', '-O', '--c-kinds=+px', '-O', '--output-format=e-ctags', '-l', '/home/roach/.cache/tags/home-roach-Nutstore_Files-我的坚果云-.tags.lo
g']
gutentags: In:      /home/roach/code/Git/dotfiles
E344: cdpath 中找不到目录 "/home/roach/Nutstore\ Files/我的坚果云"
E472: 命令执行失败
gutentags: Running: ['gtags', '--incremental', '/home/roach/.cache/tags/home-roach-Nutstore_Files-我的坚果云']
gutentags: In:      /home/roach/code/Git/dotfiles
gutentags: Finished gtags_cscope job.

Maybe same reason with #193

Just had this yesterday for me too.
Started when I went to use vim and/or MacVim remotely but it was around the same time i updated my plugins on both my local and remote machine as well as my version of MacVim (tweak released yesterday from Homebrew).

Happening over scp, with sshfs drives, just logging in over ssh to use the remote vim and just running vim locally with projects.

Here's my vim version output:
VIM - Vi IMproved 8.2 (2019 Dec 12, compiled May 17 2020 03:53:52)
macOS version
Included patches: 1-539
Compiled by Homebrew
Huge version with MacVim GUI.  Features included (+) or not (-):
+acl               +file_in_path      +mouse_urxvt       -tag_any_white
+arabic            +find_in_path      +mouse_xterm       +tcl
+autocmd           +float             +multi_byte        +termguicolors
+autochdir         +folding           +multi_lang        +terminal
-autoservername    -footer            -mzscheme          +terminfo
+balloon_eval      +fork()            +netbeans_intg     +termresponse
+balloon_eval_term +fullscreen        +num64             +textobjects
+browse            -gettext           +odbeditor         +textprop
++builtin_terms    -hangul_input      +packages          +timers
+byte_offset       +iconv             +path_extra        +title
+channel           +insert_expand     +perl              +toolbar
+cindent           +job               +persistent_undo   +transparency
+clientserver      +jumplist          +popupwin          +user_commands
+clipboard         +keymap            +postscript        +vartabs
+cmdline_compl     +lambda            +printer           +vertsplit
+cmdline_hist      +langmap           +profile           +virtualedit
+cmdline_info      +libcall           -python            +visual
+comments          +linebreak         +python3           +visualextra
+conceal           +lispindent        +quickfix          +viminfo
+cryptv            +listcmds          +reltime           +vreplace
+cscope            +localmap          +rightleft         +wildignore
+cursorbind        +lua               +ruby              +wildmenu
+cursorshape       +menu              +scrollbind        +windows
+dialog_con_gui    +mksession         +signs             +writebackup
+diff              +modify_fname      +smartindent       -X11
+digraphs          +mouse             -sound             -xfontset
+dnd               +mouseshape        +spell             +xim
-ebcdic            +mouse_dec         +startuptime       -xpm
+emacs_tags        -mouse_gpm         +statusline        -xsmp
+eval              -mouse_jsbterm     -sun_workshop      -xterm_clipboard
+ex_extra          +mouse_netterm     +syntax            -xterm_save
+extra_search      +mouse_sgr         +tag_binary
-farsi             -mouse_sysmouse    -tag_old_static
   system vimrc file: "$VIM/vimrc"
     user vimrc file: "$HOME/.vimrc"
 2nd user vimrc file: "~/.vim/vimrc"
      user exrc file: "$HOME/.exrc"
  system gvimrc file: "$VIM/gvimrc"
    user gvimrc file: "$HOME/.gvimrc"
2nd user gvimrc file: "~/.vim/gvimrc"
       defaults file: "$VIMRUNTIME/defaults.vim"
    system menu file: "$VIMRUNTIME/menu.vim"
  fall-back for $VIM: "/Applications/MacVim.app/Contents/Resources/vim"
Compilation: clang -c -I. -Iproto -DHAVE_CONFIG_H -DFEAT_GUI_MACVIM -Wall -Wno-unknown-pragmas -pipe  -DMACOS_X -DMACOS_X_DARWIN  -g -O2 -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=1
Linking: clang   -L. -fstack-protector-strong -L/usr/local/lib -L/usr/local/opt/libyaml/lib<EMAIL_ADDRESS>-L/usr/local/opt/readline/lib -L. -fstack-protector-strong -L/usr/local/lib -L/usr/local/opt/libyaml/lib<EMAIL_ADDRESS>-L/usr/local/opt/readline/lib  -L/usr/local/lib -o Vim -framework Cocoa -framework Carbon       -lm  -lncurses -liconv -framework AppKit  -L/usr/local/opt/lua/lib -llua5.3 -fstack-protector  -L/System/Library/Perl/5.18/darwin-thread-multi-2level/CORE -lperl<EMAIL_ADDRESS>-lpython3.8 -lintl -framework CoreFoundation -F/System/Library/Frameworks -framework Tcl -framework CoreFoundation -lruby.2.7

I'm getting the same issue since plugin upgrade:
Error detected while processing function gutentags#setup_gutentags[101]..<SNR>134_update_tags[42]..gutentags#chdir:
line    6:
E344: Can't find directory "/e/dev/MQL4/Shared\ Projects" in cdpath
E472: Command failed
Error detected while processing function gutentags#setup_gutentags[101]..<SNR>134_update_tags[54]..gutentags#chdir:
line    6:
E344: Can't find directory "/e/dev/MQL4/Shared\ Projects" in cdpath
E472: Command failed
Error detected while processing function gutentags#setup_gutentags:
line  101:
E171: Missing :endif

VIM - Vi IMproved 8.2 (2019 Dec 12, compiled Mar 27 2020 12:36:15)
Included patches: 1-460
Modified by<EMAIL_ADDRESS>Compiled by<EMAIL_ADDRESS>Huge version without GUI.   For me, the issue only occurs when there is a space in the path. I believe it is caused by the fnameescape command in https://github.com/ludovicchabant/vim-gutentags/commit/29de36f8b6b12186805e9d01cddff194ce44b6c2

I am having the same problem as noted above. For me, the issue only occurs when there is a space in the path. I believe it is caused by the fnameescape command in 29de36f.

Yeah, it does seem to be related to spaces in the file path passed to fnameescape(). If you look at my first screenshot you'll see the result of running this on (what I assumed would be) a space-escaped file path. This was just me trying to recreate the same issue encountered at the given line of code that the error returned.
Seeing that I also get similar errors with Nerdtree has me wondering if this is not a vim issue though. https://github.com/vim/vim/commit/5d98dc2a48156d44139b75c689bd3137ff7fe8bf#diff-18fed467ce20dda01ceb355a223a2e66

I am having the same problem as noted above. For me, the issue only occurs when there is a space in the path. I believe it is caused by the fnameescape command in 29de36f.

@dkav Did your patch solve the issue with file path spaces in your case?
I wonder if @skywind3000 added that extra escape in 29de36f in response to a particular issue. If not then there should be no reason to wait before removing it from this plugin.
Separately, do we know why it's an issue...like is fnameescape() being called too many times on a:path? Presumably it should be an idempotent operation (safely repeatable) to avoid issues like this but I'd have to reread the implementation more carefully to confirm that.
I dug down the call stack from fnameescape() in vim (git blame) and not much seems to have changed there recently that would have brought this up now.

@darwingr the patch solved my issue. FYI this is not the first time that this issue occurred - see issue https://github.com/ludovicchabant/vim-gutentags/issues/259. Also, I think @skywind3000 made the change in part in response to the reverted commit - see https://github.com/ludovicchabant/vim-gutentags/commit/31c0ead56428529c8991e45c0ac0fa7dd99e3bd0.

@darwingr the patch solved my issue too.

I have experienced the same. I have to check out 31c0ead and use it for now. I haven't tried @darwingr 's patch yet.

Thank you @dkav , @pnetherwood and @flipjs .
It appears we're all on some Unix-y OS with same sort of file paths.
@skywind3000 can we please get your breakdown of the situation on this? There seems to be a need for the change for proper windows file path escaping. Is that the case with you? I'd hate to have this creep back up in a few months.
Until this is sorted, out others having this issue under vim-plug can use:
Plug 'ludovicchabant/vim-gutentags', { 'commit': '31c0ead' }, reload, then :PlugInstall! vim-gutentags.


The outbound provisioning connector's properties' regex attribute should be properly configured

Is your feature request related to a problem? Please describe.
Since the connector properties are dynamically obtained from the API, we need the properties' regex attribute to provide the regex to validate the properties.
However, the regex attribute of all the properties has the .* pattern which would allow any value. To validate these properties, the right regex pattern should be returned from the backend.
Concerned endpoint: api/server/v1/identity-providers/meta/outbound-provisioning-connectors/{id}
Sample response:

This issue is being closed due to extended inactivity. Please feel free to reopen it if further attention is needed. Thank you for helping us keep the issue list relevant and focused!


Change field name populated

Description
I added a geo location to my strapi collection and i need to populate latitude and longitude to strapi in "_geo" field.
I need to change the name of the field from "location" to "_geo". I have the transoformation feature but that feature only allow me to change the field value, not the field name.

I found the solution adding custom field like this example "test"
        project: {           transformEntry({ entry }) {             entry.test = "asd";             return {               ...entry,               location: "asd"             }           },         }


HDFS-17684. Add bytes written and read by local client.

Add bytes written and read by local client.
LocalBytesRead 'Number of bytes read by local clients'
LocalBytesWritten 'Number of bytes written by local clients'

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
6m 28s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s

The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 56s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
18m 22s

trunk passed

+1 :green_heart:
compile
8m 37s

trunk passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
7m 41s

trunk passed with JDK Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

+1 :green_heart:
checkstyle
2m  0s

trunk passed

+1 :green_heart:
mvnsite
1m 48s

trunk passed

+1 :green_heart:
javadoc
1m 33s

trunk passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 47s

trunk passed with JDK Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

+1 :green_heart:
spotbugs
3m 10s

trunk passed

+1 :green_heart:
shadedclient
20m 25s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 20s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m  5s

the patch passed

+1 :green_heart:
compile
8m  8s

the patch passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
8m  8s

the patch passed

+1 :green_heart:
compile
7m 34s

the patch passed with JDK Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

+1 :green_heart:
javac
7m 34s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
1m 58s
/results-checkstyle-root.txt
root: The patch generated 2 new + 72 unchanged - 0 fixed = 74 total (was 72)

+1 :green_heart:
mvnsite
1m 49s

the patch passed

+1 :green_heart:
javadoc
1m 30s

the patch passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 49s

the patch passed with JDK Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

+1 :green_heart:
spotbugs
3m 24s

the patch passed

+1 :green_heart:
shadedclient
20m 28s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
16m 57s

hadoop-common in the patch passed.

-1 :x:
unit
191m 43s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 46s

The patch does not generate ASF License warnings.

344m 50s

Reason
Tests

Failed junit tests
hadoop.hdfs.TestDecommission

hadoop.hdfs.TestDecommissionWithBackoffMonitor

Subsystem
Report/Notes

Docker
ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7212/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/7212

Optional Tests
dupname asflicense mvnsite codespell detsecrets markdownlint compile javac javadoc mvninstall unit shadedclient spotbugs checkstyle

uname
Linux 1a2c8d39fe1a 5.15.0-124-generic #134-Ubuntu SMP Fri Sep 27 20:20:17 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 5e67cf2098f0e4e332fbce27c9c353a2dab1681d

Default Java
Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7212/1/testReport/

Max. process+thread count
4438 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7212/1/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

any tests? something to verify the metrics match bytes read/written?

any tests? something to verify the metrics match bytes read/written?
Added testLocalBytesMetrics.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
6m 45s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
15m 24s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
18m 20s

trunk passed

+1 :green_heart:
compile
8m 34s

trunk passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
7m 44s

trunk passed with JDK Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

+1 :green_heart:
checkstyle
1m 57s

trunk passed

+1 :green_heart:
mvnsite
1m 52s

trunk passed

+1 :green_heart:
javadoc
1m 35s

trunk passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 47s

trunk passed with JDK Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

+1 :green_heart:
spotbugs
3m 17s

trunk passed

+1 :green_heart:
shadedclient
20m 28s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 21s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m  5s

the patch passed

+1 :green_heart:
compile
8m 16s

the patch passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
8m 16s

the patch passed

+1 :green_heart:
compile
7m 46s

the patch passed with JDK Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

+1 :green_heart:
javac
7m 46s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
1m 56s
/results-checkstyle-root.txt
root: The patch generated 2 new + 81 unchanged - 0 fixed = 83 total (was 81)

+1 :green_heart:
mvnsite
1m 43s

the patch passed

+1 :green_heart:
javadoc
1m 26s

the patch passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 44s

the patch passed with JDK Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

+1 :green_heart:
spotbugs
3m 22s

the patch passed

+1 :green_heart:
shadedclient
20m 46s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
16m 14s

hadoop-common in the patch passed.

-1 :x:
unit
197m 13s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 46s

The patch does not generate ASF License warnings.

350m 53s

Reason
Tests

Failed junit tests
hadoop.hdfs.TestDecommissionWithBackoffMonitor

hadoop.hdfs.server.datanode.TestDataNodeMetrics

hadoop.hdfs.TestDecommission

Subsystem
Report/Notes

Docker
ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7212/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/7212

Optional Tests
dupname asflicense mvnsite codespell detsecrets markdownlint compile javac javadoc mvninstall unit shadedclient spotbugs checkstyle

uname
Linux 96d1c1592698 5.15.0-124-generic #134-Ubuntu SMP Fri Sep 27 20:20:17 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 99caa203dce89ae3770be24f1944e5da58c1bb1e

Default Java
Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7212/2/testReport/

Max. process+thread count
4029 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7212/2/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 20s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m  0s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
18m  0s

trunk passed

+1 :green_heart:
compile
8m 37s

trunk passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
8m  3s

trunk passed with JDK Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

+1 :green_heart:
checkstyle
1m 57s

trunk passed

+1 :green_heart:
mvnsite
1m 52s

trunk passed

+1 :green_heart:
javadoc
1m 28s

trunk passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 48s

trunk passed with JDK Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

+1 :green_heart:
spotbugs
3m  9s

trunk passed

+1 :green_heart:
shadedclient
20m 22s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 21s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m  5s

the patch passed

+1 :green_heart:
compile
8m 13s

the patch passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
8m 13s

the patch passed

+1 :green_heart:
compile
7m 46s

the patch passed with JDK Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

+1 :green_heart:
javac
7m 46s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
1m 50s
/results-checkstyle-root.txt
root: The patch generated 2 new + 81 unchanged - 0 fixed = 83 total (was 81)

+1 :green_heart:
mvnsite
1m 47s

the patch passed

+1 :green_heart:
javadoc
1m 24s

the patch passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 48s

the patch passed with JDK Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

+1 :green_heart:
spotbugs
3m 19s

the patch passed

+1 :green_heart:
shadedclient
20m 19s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
17m  3s

hadoop-common in the patch passed.

-1 :x:
unit
190m 21s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 48s

The patch does not generate ASF License warnings.

336m 19s

Reason
Tests

Failed junit tests
hadoop.hdfs.TestDecommission

hadoop.hdfs.tools.TestDFSAdmin

hadoop.hdfs.TestDecommissionWithBackoffMonitor

Subsystem
Report/Notes

Docker
ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7212/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/7212

Optional Tests
dupname asflicense mvnsite codespell detsecrets markdownlint compile javac javadoc mvninstall unit shadedclient spotbugs checkstyle

uname
Linux 76c95c6d83b6 5.15.0-124-generic #134-Ubuntu SMP Fri Sep 27 20:20:17 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 119677d20f2d01b0c7e4f59f4127f20598b299f4

Default Java
Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_432-8u432-ga~us1-0ubuntu2~20.04-ga

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7212/3/testReport/

Max. process+thread count
4784 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7212/3/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@steveloughran Sir, the failed test case are not related to this patch. Could you please help me review this PR when you are free? Thanks a lot.


Priorized Routing Algorithmen for a Locomotive to Clean All Tracks with Cleaning-Train

A specific train can be configured to drive-threw all blocks to allow to clean all tracks.

implemented


the model of pc2cad.py

Excuse me, would you mind sharing me the pretrained model of pc2cad.py for studying? My email is<EMAIL_ADDRESS>Thank you very mush.

hello,have you the pretrained model of pc2cad.py for studying now?

Hi, unfortunately I couldn't find it now.

Hi Chris,
Is the script for training the model used in pc2cad.py in the repository? It would be very interesting to play with this a bit!
If not, could you add it?

I managed to find a version of and uploaded: https://github.com/ChrisWu1997/DeepCAD/blob/master/pc2cad_train.py. Hope it helps!

Great, thanks Chris!


Secure Cookie flag

Secure flag for Cookie marks when a Cookie can only be sent over HTTPS connection.
Related to #1415,

+1

+1

https://developer.mozilla.org/en-US/docs/Web/HTTP/Cookies#Secure_and_HttpOnly_cookies

Is this distinct from HttpOnly (#1415) and cookie prefixes (#4311)?
If not, I believe these are now covered by MDN data:
https://caniuse.com/mdn-http_headers_set-cookie_httponly
https://caniuse.com/mdn-http_headers_set-cookie_cookie_prefixes

It appears to be distinct. A cookie prefix can impose a requirement that the cookie also have the Secure flag. So optimal security might involve using both together, but even then, the MDN example for prefixes shows the server also setting the Secure flag explicitly.
HttpOnly would be more intuitively termed NotReadableFromJavaScript, so there's no relation to Secure (i.e. HTTPS-only).

It appears to be distinct. A cookie prefix can impose a requirement that the cookie also have the Secure flag.

Oh, yes, of course:
https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Set-Cookie
https://httpwg.org/specs/rfc6265.html#rfc.section.<IP_ADDRESS>
Is this covered by "Secure context required" and/or "schemeful"?
https://caniuse.com/mdn-http_headers_set-cookie_samesite_secure_context_required
https://caniuse.com/mdn-http_headers_set-cookie_samesite_schemeful

I'm not sure keyword-searching unaccompanied by research is an optimal method for correlating features to MDN data...
Presumably "secure context" refers to https://w3c.github.io/webappsec-secure-contexts/ , which is in large part about framing and workers, not just HTTPS; so I'm skeptical of any relation to cookies. But it's also unclear WTF that MDN datum is about.

But it's also unclear WTF that MDN datum is about.

That's precisely why I was asking. I was trying to correlate available compat data with the topics covered on the MDN documentation page.
A lot has changed in the realm of security since Set-Cookie was introduced and, indeed, since this issue was filed. I am merely trying to identify whether the use and support of Secure has been superseded or subsumed by another concept (such as SameSite).
FWIW, "secure context required" was added in mdn/browser-compat-data#5426 and "schemeful" was added in mdn/browser-compat-data#9352.


Include LoRA to the GReaT framework for efficient and fast fine-tuning

The incorporation of the LoRA technique will enhance the speed of fine-tuning and decrease computational demands. Contributions are welcome.
About the LoRA: https://www.philschmid.de/fine-tune-flan-t5-peft

I created a PR for this purpose. I think one problem is that for each LM, the (LoraConfig) is different, my current one is working with GPT2 model (which is the demo given in the readme), should have a more general way to adapt that.

For the experiment, I tested on a small dataset with distilgpt2, one thing noticeable is that the memory usage is reduced about 50% (on current r setting in LoraConfig), training time per epoch is also reduced by about 25%. I didn't the table quality yet. To be continued.

Hi @zhao-zilong,
Thank you for your PR!
I apologize for the late response. I had my phd defense and then a lot of movements between countries and bars.
Regarding your PR, my vision is that it will be an optional feature, if a user wants to speed up fine-tuning/training, she/he can use LoRA, but by default it will be the normal training.
I'm happy to accept your pull requests if you make these changes.
Something like this:
model = GReaT(llm='distilgpt2', batch_size=32, epochs=50, efficient_finetuning='lora')
model.fit(data)
synthetic_data = model.sample(n_samples=100)

Hi @unnir  I updated the great.py code in PR, have a look.

And forgot to say, congratulations!

Thank you, Zhao :)
Approved and merged, thank you for your contribution! I will do tests  :)


no-cache problem when using livewire.

<meta name="turbo-cache-control" content="no-cache">

Because I'm having issues with caching menus, etc. I gave you that option.
But, if I give this option and go to another page
Uncaught (in promise) TypeError: Cannot read properties of undefined (reading '$wire')

An error occurs.
I used this option in turbolinks, is it not possible to use it in turbo?

Problems arise when using no-cache,
To solve the content caching, using <meta name="turbo-cache-control" content="no-preview"> seems to have solved it.

I don't see how that could break the package. It seems you're using Livewire. If so, make sure you're on the latest version. Also, make sure you're using the Livewire/Turbo Bridge. And if you're using Alpine, also make sure you're using the latest version, 'cause there's a fix for Turbo there.
I'm closing the issue for now, feel free to reopen it. But, please, provide more info on what stack you're using, and maybe try to create a sample application reproducing the error and publish it to GitHub so I can take a look.
Cheers,


Next Learn: missing call to await fetchCustomers() in Ch 12

Step 3. Fetch the specific invoice, tell us to fetch the invoice by Id but the form expects also the list of customers.
the example should show how to also retrieve customers.
either
customers = await fetchCustomers();
or, as in your code
const [invoice, customers] = await Promise.all([
fetchInvoiceById(id),
fetchCustomers(),
]);

Thank you @MarcoPeretti, fixed. Should be landing soon :)


Gamelift - How to set game session port?

OS: Windows
SDK Version: 1.7.242
Visual Studio 2017
CMAKE Arguments:

BUILD_ONLY = core;cognito-identity;gamelift

Hi
I have unreal project with custom gamelift client. When i create game session, i have to set game properties with key="Port" and value=7778. But unfortunately, when i run it, the result of session game in my console use port 7777. I don't know to find any references about game properties example. What should i do to set game session port?
Thanks

Hi @ArifBudiman19 I'll take a look into this, but while I try and setup a way to reproduce this, could you give me a small sample code on what you're trying to do?

`EActivateStatus UGameLiftCreateGameSession::Activate()
{
#if WITH_GAMELIFTCLIENTSDK
if (GameLiftClient)
{
LOG_NORMAL("Preparing to create game session...");
	if (OnCreateGameSessionSuccess.IsBound() == false)
	{
		LOG_ERROR("No functions were bound to OnCreateGameSessionSuccess multi-cast delegate! Aborting Activate.");
		return EActivateStatus::ACTIVATE_NoSuccessCallback;
	}

	if (OnCreateGameSessionFailed.IsBound() == false)
	{
		LOG_ERROR("No functions were bound to OnCreateGameSessionFailed multi-cast delegate! Aborting Activate.");
		return EActivateStatus::ACTIVATE_NoFailCallback;
	}

	Aws::GameLift::Model::CreateGameSessionRequest GameSessionRequest;

	GameSessionRequest.SetMaximumPlayerSessionCount(SessionConfig.GetMaxPlayers());

	if (bIsUsingGameLiftLocal)
	{
		GameSessionRequest.SetFleetId(TCHAR_TO_UTF8(*SessionConfig.GetGameLiftLocalFleetID()));
	}
	else
	{
		GameSessionRequest.SetAliasId(TCHAR_TO_UTF8(*SessionConfig.GetAliasID()));
	}

	LOG_NORMAL("Setting Alias ID: " + SessionConfig.GetAliasID());
	for (FGameLiftGameSessionServerProperties ServerSetting : SessionConfig.GetGameSessionProperties())
	{
		LOG_NORMAL("********************************************************************");
		Aws::GameLift::Model::GameProperty MapProperty;
		MapProperty.SetKey(TCHAR_TO_UTF8(*ServerSetting.Key));
		MapProperty.SetValue(TCHAR_TO_UTF8(*ServerSetting.Value));
		GameSessionRequest.AddGameProperties(MapProperty);
		LOG_NORMAL(FString::Printf(TEXT("New GameProperty added. Key: (%s) Value: (%s)"), *ServerSetting.Key, *ServerSetting.Value));
	}

	Aws::GameLift::CreateGameSessionResponseReceivedHandler Handler;
	Handler = std::bind(&UGameLiftCreateGameSession::OnCreateGameSession, this, std::placeholders::_1, std::placeholders::_2, std::placeholders::_3, std::placeholders::_4);

	LOG_NORMAL("Starting game session...");
	GameLiftClient->CreateGameSessionAsync(GameSessionRequest, Handler);
	return EActivateStatus::ACTIVATE_Success;
}
LOG_ERROR("GameLiftClient is null. Did you call CreateGameLiftObject first?");

#endif
return EActivateStatus::ACTIVATE_NoGameLift;
}`

Code link https://github.com/ArifZx/GameliftClientPlugin/blob/master/Plugins/GameLiftClientSDK/Source/GameLiftClientSDK/Private/GameLiftClientApi.cpp


Support minValue maxValue in the sdc gallery

See http://build.fhir.org/ig/HL7/sdc/behavior.html

minValue	question (where type='date', 'dateTime', 'time', 'decimal', 'integer')
This extension is used for questions with simple quantitative types. The extension allows establishing the lower bound for an answer. For example, ensuring that birth dates are >= 1990-01-01 or an integer is greater than or equal to 0. (Note that the integer and decimal types both allow negative numbers if not constrained.) This extension can be used together with the cqf-calculatedValue extension to establish a dynamic limit. For example, ensuring that a date of birth will result in a maximum age by setting minValue with an expression of 'today() - 18 years'.
The minValue SHALL be less than or equal to the maxValue, if both are specified. If min and/or max are calculated values, care should be taken to ensure that they cannot ever conflict. I.e. It should never be possible for calculated max to be less than calculated min. If this does occur, systems SHALL prohibit a value from being specified for the element for so long as the conflict exists. If the question is required, this may mean that it is not possible to mark the QuestionnaireResponse as "completed".
maxValuebquestion (where type='date', 'dateTime', 'time', 'decimal', 'integer')
This extension is used for questions with simple quantitative types. The extension allows establishing the upper bound for an answer. For example, ensuring that birth dates are >= 1990-01-01 or an integer is greater than or equal to 0. (Note that the integer and decimal types both allow negative numbers if not constrained.) This extension can be used together with the cqf-calculatedValue extension to establish a dynamic limit. For example, ensuring that a date of birth will result in a minimum age by setting maxValue with an expression of 'today() - 18 years'.
The minValue SHALL be less than or equal to the maxValue, if both are specified. If min and/or max are calculated values, care should be taken to ensure that they cannot ever conflict. I.e. It should never be possible for calculated max to be less than calculated min. If this does occur, systems SHALL prohibit a value from being specified for the element for so long as the conflict exists. If the question is required, this may mean that it is not possible to mark the QuestionnaireResponse as "completed".

cqf-calculatedValue support is out of scope

@kunjan8794 are you interested in taking this?

@kunjan8794 are you interested in taking this?

Surely, I'll take this up. Thanks 👍🏻

Surely, I'll take this up. Thanks 👍🏻

Awesome :) There are a few different data types to support (see comment above) but you can certainly start with one type (e.g. integer) and send a pr.

Awesome :) There are a few different data types to support (see comment above) but you can certainly start with one type (e.g. integer) and send a pr.


Document HAL features in Config.toml(s), and enable ROM function caching in BSPs

The features of the rp2040-hal were not documented in any of the Config.toml files.
Also, some features were not re-exposed by the BSPs so would be difficult to discover.
Finally, updated the default features of each BSP to include the USB enumeration errata and ROM function pointer caching, since it is likely that most users will want these but will have difficulty finding them on their own.

Removed USB enumeration errata feature from defaults in the last commit, no other changes


exclude test in report if reference has failed subtests in test

Not only subtests will be excluded in the report if it failed in a reference browser, but the complete test as soon as one subtest failed in one of the references.

lgtm, please merge


physically_based_rendering_wgpu sample composites to black

All the other layers except the final composite seem to work

systeminfo
OS Name:                   Microsoft Windows 11 Pro
OS Version:                10.0.22621 N/A Build 22621

info: [zgpu]   Name: AMD Radeon RX 6950 XT
info: [zgpu]   Driver: D3D12 driver version 31.0.14043.1000.
info: [zgpu]   Adapter type: discrete_gpu
info: [zgpu]   Backend type: d3d12

zig version
0.11.0-dev.2620+23ac4dd87

Don't know why but it started working.


[11.x] Add MSSQL 2017 and PGSQL 10 builds

Test the low end supported databases.
Would love to get help getting the tests to pass.

It seems like generated columns only exist as of PostegreSQL 12:
https://www.postgresql.org/docs/12/ddl-generated-columns.html
This Documentation (5.3 Generated Columns) does not exist on v11 or v10:
https://www.postgresql.org/docs/10/ddl.html

websearch_ts_query exists only as of PostgreSQL v11: https://www.postgresql.org/docs/release/11.0/

Primary key and foreign key on partitioned tables only exists as of PostgreSQL v11:
https://www.postgresql.org/docs/release/11.0/

Thanks @Jubeki. We should be able to skip these tests then somehow.

version_compare(Schema::getConnection()->getServerVersion(), '12.0', '<')

This should probably work.

Was thinking more like a Phpunit annotation but I guess Phpunit doesn't uses those anymore? 🤔

There is already a check for the used type of database, so I don't think there is an Attribute for that:
https://github.com/laravel/framework/blob/13d28862ce18cfc6609080fcb02cd649b3eede82/tests/Integration/Database/SchemaBuilderTest.php#L342-L344

Maybe @crynobone has an idea about the Attributes.

You need to write one to hook with Testbench, something like:
<?php

namespace Illuminate\Tests\Testbench\Attributes;

use Attribute;
use Closure;
use Illuminate\Support\Facades\DB;
use Orchestra\Testbench\Contracts\Attributes\Actionable as ActionableContract;

#[Attribute(Attribute::TARGET_CLASS | Attribute::TARGET_METHOD | Attribute::IS_REPEATABLE)]
class RequiresDatabase implements ActionableContract
{
    /**
     * Construct a new attribute.
     *
     * @param  string  $driver
     * @param  string  $versionRequirement
     */
    public function __construct(public string $driver, public string $versionRequirement)
    {
        //
    }

    /**
     * Handle the attribute.
     *
     * @param  \Illuminate\Foundation\Application  $app
     * @param  \Closure(string, array<int, mixed>):void  $action
     * @return void
     */
    public function handle($app, Closure $action): void
    {
        $connection = DB::connection($this->driver);

        if (
            preg_match('/(?P<operator>[<>=!]{0,2})\s*(?P<version>[\d\.-]+(dev|(RC|alpha|beta)[\d\.])?)[ \t]*\r?$/m', $this->versionRequirement, $matches)
        ) {
            if (empty($matches['operator'])) {
                $matches['operator'] = '>=';
            }

            if (! version_compare($connection->getServerVersion(), $matches['version'], $matches['operator'])) {
                call_user_func($action, 'markTestSkipped', [sprintf("Requires %s:%s", $connection->getName(), $this->versionRequirement)]);
            }
        }
    }
}

It's okay. Fine to leave the current skips. Just need to fix the postgres types failure and then this one is ready to go,.

Nice, thanks @Jubeki


useResizeColumns does not clean up eventlistener for touch events properly.

In the following code, shouldn't line 92 be handlersAndEvents.touch.upHandler instead?
https://github.com/tannerlinsley/react-table/blob/efaaa71baadff44d1109f4cdbff1014fa1a0a5ab/src/plugin-hooks/useResizeColumns.js#L85-L95

Indeed. Please submit a PR with a fix if this is urgent, otherwise we will slate the fix for v8.


Spacing rules

Spacing rules should allow for any spacing to be maintained between items on the same line.
There should also be a flag for the compiler to maintain spacing. There may need to be 2 flags, one to maintain line trimmings and one to maintain newlines.
The following examples use the · to symbolize spaces
This should maintain spacing:
Hello······{world}···spacing

Output:
Hello······world···spacing

The beginning and ends of lines may be trimmed (unless maintainSpacing is enabled.
····Hello······world···spacing····

Output:
Hello······world···spacing

But multiline things do not maintain spacing, only same line
····Hello······
world···spacing····

Output: (without lines maintained)
Helloworld···spacing

Turns out, it's not really an issue too much. It does remove spacing at the beginning of a line, but does not trim the white space at the end of a line. Not really a big deal though, someone may desire that spacing to carry over to the next line.


catalog app does not load on IE11

Kind of a proof that core-js is really gone (#128). :wink:
ReferenceError: "Symbol" is undefined
see https://github.com/aurelia-ui-toolkits/aurelia-materialize-bridge/issues/127#issuecomment-191682959

Seems that this one would need to be re-opened.

Right, looks like it..
It's probably this part:
//Configure Bluebird Promises.
Promise.config({
  warnings: {
    wForgottenReturn: false
  }
});

That's interesting since bluebird should be loaded before anything else.
Thanks for reporting, I'll have a look.

Also content padding is missing when the side-nav is opened (probably failing media queries).

Well, this works:
(Promise.config || P.config)({
  warnings: {
    wForgottenReturn: false
  }
});

I have no idea why window.Promise doesn't have config() but window.P does. And that only in IE..
I'd like to investigate this further. Uploading this as a workaround.

That was fast ^_^
IE is always full of nice gifts like this one !

I'm now getting this with any browser and the reason is: GitPages doesn't deliver bluebird..

Fixed


I'd like to re-open feedback #30807 - "What are deprecated accounts"

I had another customer ask me the same question, and I don't see anywhere in the docs w/ a good definition of deprecated accounts. Item 30807 says we would clarify the docs last year, but I don't see any result.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: b59d5bc1-0e5e-4183-58e3-da7b20a450c6
Version Independent ID: 1c8c8961-2caa-b3ae-7bb2-9ca61a3fdf5b
Content: Monitor identity and access in Azure Security Center
Content Source: articles/security-center/security-center-identity-access.md
Service: security-center
GitHub Login: @memildin
Microsoft Alias: memildin

@daweins , Thank you for your feedback. We will investigate and get back to you shortly.
https://github.com/MicrosoftDocs/azure-docs/issues/30807

@daweins The article was indeed updated but has changed since then . I will have this looked into by the author to see if we can add a not explaining deprecated accounts on the page. Earlier the page had a recommendations section below but it had been updated with the changing product.  You can find the following table for reference. I will try to find more information and let you know accordingly.

Recommendations
Use the table below as a reference to help you understand the available Identity & Access recommendations and what each one does if you apply it.

Resource type
Secure score
Recommendation
Description

Subscription
50
Enable MFA for Azure Management App accounts with owner permissions on your subscription
Enable Multi-Factor Authentication (MFA) for all subscription accounts with administrator privileges to prevent a breach of accounts or resources.

Subscription
50
Enable security center on your subscriptions
Enable Security center on all your subscriptions for advanced threat detection, JIT , application whitelisting and advanced recommendations

Subscription
50
Enable security center standard tier on your subscriptions
Enable Security center Standard Tier on all your subscriptions for advanced threat detection, JIT , application whitelisting and advanced recommendations.

Subscription
40
Enable MFA for Azure Management App accounts with write permissions on your subscription
Enable Multi-Factor Authentication (MFA) for all subscription accounts with write privileges to prevent a breach of accounts or resources.

Subscription
30
Remove external accounts with owner permissions from your subscription
Remove external accounts with owner permissions from your subscription in order to prevent unmonitored access.

Subscription
30
Enable MFA for Azure Management App accounts with read permissions on your subscription
Enable Multi-Factor Authentication (MFA) for all subscription accounts with read privileges to prevent a breach of accounts or resources.

Subscription
25
Remove external accounts with write permissions from your subscription
Remove external accounts with write permissions from your subscription in order to prevent unmonitored access.

Subscription
20
Remove  deprecated accounts with owner permissions from your subscription
Remove deprecated accounts with owner permissions from your subscriptions. Deprecated accounts are the accounts for which sign-in has been blocked in Azure AD.

Subscription
5
Remove deprecated accounts from your subscription
Remove deprecated accounts from your subscriptions to enable access to only current users. Deprecated accounts are the accounts for which sign-in has been blocked in Azure AD.

Subscription
5
Designate more than one owner on your subscription
Designate more than one subscription owner in order to have administrator access redundancy.

Subscription
5
Designate up to 3 owners on your subscription
Designate less than 3 subscription owners in order to reduce the potential for breach by a compromised owner.

Key vault
5
Enable diagnostic logs in Key Vault
Enable logs and retain them up to a year. This enables you to recreate activity trails for investigation purposes when a security incident occurs or your network is compromised.

Subscription
15
Remove external accounts with read permissions from your subscription
Remove external accounts with read privileges from your subscription in order to prevent unmonitored access.

Subscription
1
Provide security contact details
Provide security contact information for each of your subscriptions. Contact information is an email address and phone number. The information is used to contact you if our security team finds that your resources are compromised

![NOTE]
If you created a conditional access policy that necessitates MFA but has exclusions set, the Security Center MFA recommendation assessment considers the policy non-compliant, because it enables some users to sign in to Azure without MFA.

@memildin Could you please provide your inputs on this. Do u think a note on deprecated accounts can be added on this ?

The use of "deprecated accounts" on this page is just to cite an example of the recommendations that might appear for identity and access management.
The deprecated accounts policy listed on the policy page already includes a definition of deprecated accounts ("Deprecated accounts are accounts that have been blocked from signing in.").
Nevertheless, I've worked a definition of deprecated accounts into the text as follows:

By monitoring identity activities, you can take proactive actions before an incident takes place, or reactive actions to stop an attack attempt. For example, Security Center might flag deprecated accounts (accounts that are no longer needed, and blocked from signing in by Azure Active Directory) for removal.
Examples of recommendations you might see on the Identity and access resource security section of Azure Security Center include:......

@daweins I hope this clarifies the details about deprecated accounts. We will now close this issue. Should you still have any queries , please tag me or @memildin to your reply and we will be happy to help .


Added core_user.username UPPER index, as it is mostly compared with

Also:

fix the order of the migrations
added missing blank to project.last_package_job

While the DB distinguishes the upper and lower case, we do support case-insensitive login and URLs. It means we need to enforce only one case.
Also, we have quite some User.objects.filter(username__iexact='suricactus'), which converts the string to uppercase and skips using the index.
This makes sure the values are unique case insensitive.

Ok, I got mistaken by the regex validator on username which accepts uppercase (despite converting to lowercase when creating an account).
In the longer term it could be safer to do exact comparisons only and convert user input to lowercase instead (I guess we get the username from the URL), and also enforce only lowercase usernames by changing the validator. This way if somehow user with uppercase make it to the DB (could happen with a batch import or using oauth), we don't risk collision which could be a security issue.

I think we should keep the case in the db. An example is OPENGISch which is the official name of one of the organizations. While it is safer to accept only one case, it is a bit limiting.

Ok to keep as is for now then (with your new UNIQUE index it should be safe anyway).


181745735 Download problem with hyphenated Civil Parishes (John)

Issue reported by johnt at 2020-10-04 12:55:35 UTC
Time: 2020-10-04T12:49:57+00:00
Session ID: d1691d98ea7dd7ef4c7ac30958184d51
Problem Page URL: /freecen_csv_files/my_own?locale=en
Previous Page URL: https://test3.freecen.org.uk/csvfiles/5f797c07e93790274b5f2ede/edit?locale=en
Reported Issue:
There is a problem within the download routine where there are hyphenated civil parishes such as  Beaumont-Chase. The load program handles this ok, but when you download the file there is no hyphen present, hence re-loading produces civil parish errors.

@johnt-freecen @geoffj-FUG
This is an aspect of a much wider issue that we need to address and one that needs to be part of a new document. The Initial Setup of a county under FC2.
As you are aware we extract the District, Piece and Cial Parishes from TNA for all years. Unfortunately for us they and/or the original  District and Sub District Superintendents were not consistent with their naming over the years. More unfortunately we have to be consistent. The matter raised here by John is most timely. If you both look at Freecen2 Civil Places for Rutland you will see what I mean.

Looking down Rutland there is a similar issue for Edith Weston/Edith-Weston; Holt/Holt or Nevill Holt; Leigh-Field Forest/Leighfield; Market Overton/Market-Overton: There are a few others that may need consideration.
Perhaps we should write this as a separate story.
IMO the fist task  the initial setup of a county is to go through the Districts, Pieces and Civil Parishes to ensure consistency and linkage to Places

Kirk, John
Whilst this is being considered should we throw in the Out of County Places as well?
If you look at Somerset you will find that Appledore is shown in Somerset in 1901, and only 1901. It is actually in Devon so is showing in the incorrect County.
Similarly Bitton is in GLS but the Registration District was in Somerset from 1851-1911.
These examples will also cause problems during searching.
I think that this background issue is now showing its true colours.
Maybe we need an additional field so that when the Coordinator is doing their review for hyphens etc they can enter the correct County. It could be prefilled with the County of the Reg District and the Coordinator just does a few edits.
Geoff

@johnt-freecen @geoffj-FUG
Have resolved the issue. The download was the symptom of an issue rather than the cause.
The cause was my old enemy titlieze (A ruby method) which drops the - for some reason best known to itself.
As you are aware CsvProc is case insensitive but for consistency and professional display we impose certain case controls. Rather than apply the case control whenever and wherever we display a field we store the field the way we want to display it. Hence in this case we were dropping the - on storage.
To cut the long story short it is now resolved on test3.
Thank you for picking the issue up now.
You will have to reload the file with the - present to achieve consistent performance with your testing.
The matter of consistent Civil Parish naming does however remain to be addressed but that is a different story.

Hi Kirk,
I have just uploaded the file with the hyphens in place and then downloaded and they are present, so I think we can close the case.
Regards
John
Sent from Mail for Windows 10
From: Kirk Dawson
Sent: 05 October 2020 16:35
To: FreeUKGen/FreeCENMigration
Cc: johnt-freecen; Mention
Subject: Re: [FreeUKGen/FreeCENMigration] 181745735 Download problem withhyphenated Civil Parishes (John) (#1001)
@johnt-freecen @geoffj-FUG
Have resolved the issue. The download was the symptom of an issue rather than the cause.
The cause was my old enemy titlieze (A ruby method) which drops the - for some reason best known to itself.
As you are aware CsvProc is case insensitive but for consistency and professional display we impose certain case controls. Rather than apply the case control whenever and wherever we display a field we store the field the way we want to display it. Hence in this case we were dropping the - on storage.
To cut the long story short it is now resolved on test3.
Thank you for picking the issue up now.
You will have to reload the file with the - present to achieve consistent performance with your testing.
The matter of consistent Civil Parish naming does however remain to be addressed but that is a different story.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.


Updated aws-amplify modules

Description of changes:

updated amplify modules

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

👍 👍

👍 👍


[T4A7][T10-B1]Lim Wei Ming Ronald

Ready for review.

@RonaldLWM Some comments added. Please close the PR after reading comments.


Setting up MySQL support after installation

Hello,
How can I set up MySQL support after I have already installed? I have attempted to run the installer again, but I am not given the option to supply MySQL information.

Deleting the following files from your existing lite installation should give you the option to install advanced features. Keep in mind you will loose any information saved to XML files which is what the lite version uses to store data. Essentially you will be starting from scratch except for system graphs which should remain in tact.
Delete /var/www/html/classes/settings.class.php then execute install.sh reinstall the portal and choose advanced features. Follow the instructions as you would a clean installation.


Single branch fetch take 2

Another take at https://github.com/buildkite/agent/commit/d19df370bca173a8d41abe5d536545057f413b7e
Can be tested like this:
git clone --single-branch -b offical-aws-lib -- \
  git@github.com:buildkite/agent.git
cd agent
git fetch origin refs/heads/offical-aws-lib
git reset --hard refs/heads/offical-aws-lib

NB: --single-branch doesn't create a shallow repository, only --depth does. But it's a repository that doesn't track all upstream branches.
Also I totally understand if you think this is too complicated, we can run our own checkout script, we don't do it for simplicity though.

Here's the test I tried:
Create master/HEAD build
$ git clone -qv --single-branch -b master -- https://github.com/buildkite/agent-tests.git .
Cloning into '.'...
POST git-upload-pack (152 bytes)
remote: Counting objects: 714, done.
remote: Compressing objects: 100% (149/149), done.
remote: Total 714 (delta 95), reused 0 (delta 0), pack-reused 535
Receiving objects: 100% (714/714), 10.03 MiB | 587.00 KiB/s, done.
Resolving deltas: 100% (330/330), done.
Checking connectivity... done.
$ git clean -fdq
$ git submodule foreach --recursive git clean -fdq
$ git fetch -q origin refs/heads/master
$ git reset --hard refs/heads/master
HEAD is now at e3630a8 Need git@ for private repos
$ git checkout -qf HEAD
$ git submodule sync --recursive
$ git submodule update --init --recursive
$ git submodule foreach --recursive git reset --hard

Then create a windows-pr/HEAD build. I then got this error:
$ git remote set-url origin https://github.com/buildkite/agent-tests.git
$ git clean -fdq
$ git submodule foreach --recursive git clean -fdq
$ git fetch -q origin refs/heads/windows-pr
$ git reset --hard refs/heads/windows-pr
fatal: ambiguous argument 'refs/heads/windows-pr': unknown revision or path not in the working tree.
Use '--' to separate paths from revisions, like this:
'git <command> [<revision>...] -- [<file>...]'
exit status 128

@keithpitt I got a similar error in the released 2.1.4 agent:
$ mkdir -p "/var/lib/buildkite-agent/builds/ip-10-0-40-169-2/culture-amp/murmur"
$ cd "/var/lib/buildkite-agent/builds/ip-10-0-40-169-2/culture-amp/murmur"
$ git remote set-url origin "git@github.com:cultureamp/murmur.git"
$ git clean -fdq
$ git submodule foreach --recursive git clean -fdq
$ git fetch -q origin cc7eed67f5f3c9ec216ab114837adbf34a552d13 2> /dev/null || git fetch -q
$ git reset --hard origin/release_064
fatal: ambiguous argument 'origin/release_064': unknown revision or path not in the working tree.
Use '--' to separate paths from revisions, like this:
'git <command> [<revision>...] -- [<file>...]’

I'm thinking it should be fetching the branch and resetting to the commit instead of the other way around?

@TimMoore weird.. I knew we had a problem in the 2.1 release, but I thought I'd fixed that in 2.1.4. Does your bootstrap.sh file have the phrase single-branch in it?

Could be because that repo was initially cloned with --single-branch and then later the agent was upgraded to 2.1.4?
If so the simplest course of action might be to do a clean checkout.
Sorry for that :/

Ah yes, that could be it!
No sweat, it worked for me when I tested it :P (just forgot to test with a fresh repo)

We went with a custom bootstrap script in the end, so closing.

I've had another idea about this by the way.
Instead of having each build folder do it's own git clone git@github.com:/..., what if the agent by default, cloned repositories to /var/buildkite-agent/repositories/git-github-com-x-y, and each build just git fetched and git cloned from that directory, instead of the internet.
We could do some locking where only 1 agent does the git fetch for the entire build, and the rest just clone again from the cached repo. What do you think?
(Idea inspired from https://github.com/square/git-fastclone)

It's precisely what we are doing in our custom script.
We don't lock though but I think we should because we had a couple corrupt cache repos (I'm still not entirely sure what the root cause is, and it doesn't happen a lot but I keep an eye on it).

@toolmantim just pointed out to me that git has a lock file, but maybe that's not very reliable?

I'm glad that we've come to the same idea though :) I'm keen to roll this into the agent as the default behaviour. Would you be able to share what you've done?

It mostly is yes. That's why I'm not sure the corrupted repositories were because of the concurrency. Also the 2 corruptions we had were on the same host in a very short time, so I blame network / ec2 fuckery even though I have no proof.

Would you be able to share what you've done?

Sure there is really no secret sauce in there, but I'm not sure if it would be super useful, I started from scratch in ruby, and I use modern git options (uploadpack.allowReachableSHA1InWant )
But just in case it would help: https://gist.github.com/byroot/2b4b6d02af1b123b2554

Also note that local clones, if on the same physical drive, will automatically use hardlinks to save space and also be faster.

Oh wow! You rewrote the bootstrap in ruby!

Where does the hardlink stuff happen? Maybe I'm blind and can't see it.

Ah! @toolmantim just explained to me that hard links are a git thing :)

In git itself, my message probably wasn't clear. You have an option to force it, but usually git will do it if it can:
from git help clone
       --local, -l
           When the repository to clone from is on a local machine, this flag bypasses the normal "Git aware" transport mechanism and clones the repository by
           making a copy of HEAD and everything under objects and refs directories. The files under .git/objects/ directory are hardlinked to save space when
           possible.

           If the repository is specified as a local path (e.g., /path/to/repo), this is the default, and --local is essentially a no-op. If the repository is
           specified as a URL, then this flag is ignored (and we never use the local optimizations). Specifying --no-local will override the default when
           /path/to/repo is given, using the regular Git transport instead.


Unexpected behavior regarding attrs support

I'm really sorry, but I think you may need to revert my changes regarding attrs support. It seems that attrs  doesn't necessarily need runtime type annotiations and moving all out of TYPE_CHECKING block may result in circular imports.
I will investigate how attrs  handles runtime type annotations and come back with a fixed proposal.

Then perhaps instead of reverting the PR, we could add a type-checking-cattrs-enabled setting which marks attrs type hints as needed at runtime when true? Would the decorators we've used still be exactly the same?
For some context: in the pydantic case we cannot know which classes are pydantic classes, so the behavior for that feature (regrettably) is to just always allow class var type hints as long as the flag is true. Having a cattrs settings which opts into the code you've already written already sounds much more robust and precise than that.

In principle that should work, however, having no imports in TYPE_CHECKING blocks may lead to circular import errors. I don't know how pydantic handles that since it actually needs the type defs at runtime.
But I think your idea is fine and maybe when the cattrs devs introduce some kind of mechanism to mark cattrs classes, it can be changed to that marker. The underlying routines should exactly the ones that I implemented, just checking against a different decorator then.

Would it not simply require

A setting defined in the plugin, and passed to the TypingOnlyImportsChecker
An if-statement to only run the attrs code if the setting is true?

Yes, but this approach will include all attrs classes in a package. With an additional marker you could specify exactly which classes will be part of a cattrs structure call. Sadly you can't check against a cattrs import, see the following example:
main.py
import cattrs
import json
from . import Topology

with open("data/topology.json") as f:
    data = json.load(f)

topology = cattrs.structure(Topology, data)

topology.py
import attrs
from . import Node

@attrs.define
class Topology:
    node: Node

node.py
import attrs
import Array

@attrs.define
class Node:
    value: Array

other_node.py
import attrs
import AnotherArray

@attrs.define
class OtherNode:
    value: AnotherArray

Here, AnotherArray should be put into a TYPE_CHECKING block because OtherNode is not used in any cattrs structure call, however, since all attrs class attributes are exempt, the plugin won't tell us.
But I think it would be a good enough implementation for now.

It seems that the cattrs case extends to other types of classes, not just attrs. For example, this will fail:
from __future__ import annotations

from dataclasses import dataclass
from typing import TYPE_CHECKING

import cattr

if TYPE_CHECKING:
    from typing import List

@dataclass
class S:
    s: List[int]

cattr.unstructure(S([1, 2, 3]))

But maybe we can just add dataclass-detection to the cattrs setting

Think we can consider this closed. Do you agree @sasanjac? 🙂


map: rearrange layer options in layers list

re: https://github.com/CartoDB/cartodb/issues/12999

acceptance
"Edit layer" option should always appear first

retest this please


Bus error in extracting features in Odroid C2

Context of the issue.
I was setting up a sample example environment, I got error while executing command to extract features for aligned images. I am using Odroid C2.
Command executed :
odroid@odroid64:~/face-recognition/openface$ ./batch-represent/main.lua -outDir classify-test/features -data classify-test/aligned
Actual behavior.
{
  outDir : "classify-test/features"
  imgDim : 96
  device : 1
  data : "classify-test/aligned"
  model : "/home/odroid/face-recognition/openface/models/openface/nn4.small2.v1.t7"
  cuda : false
  batchSize : 50
  cache : false
}
**Bus error**

Based on my observation and debugging on ./batch-represent/main.lua file, I observed, the error coming from the below two lines
paths.dofile('dataset.lua')
paths.dofile('batch-represent.lua')

OS and hardware information.

Operating system: Ubuntu 14.04
Torch version: torch7
CPU architecture: 64-bit
Device : Linux odroid64 3.14.65-61 aarch64 GNU/Linux

Hi @nitish11 - what line of batch-represent is causing this?

@bamos :
The error is coming from  below from line.
When I checked dataset.lua, I error came at line
local initcheck = argcheck{ ....
...........

The issue was in installation of Torch. Install torch using following instructions.
rm -rf ~/torch

# in a terminal, run the commands WITHOUT sudo
git clone https://github.com/torch/distro.git ~/torch --recursive
./clean.sh
cd ~/torch; bash install-deps;
./install.sh

# On Linux with bash
source ~/.bashrc

luarocks install nn
luarocks install dpnn

Test torch installation using :
 th -lnn -e "nn.test()"


Problems with some unicode characters?

Hello,
I'm using buffpy to update my buffer and I've found problems when tryint to put this string:
u"Why Today’s Security Measures Just Don’t Cut It."
The problematic character seems to be the Unicode Character 'RIGHT SINGLE QUOTATION MARK' (U+2019) which appears twice in this string.
Looking at the code, it seems to be using unicode, but when passing the parameters to the oauth module (in api.py, line:
response = self.session.post(url=BASE_URL % url, headers=headers, **params)
text in params ('data', in particular) is unicode and the module (at least in my computer) seems to be expecting strings.
I've put before this line, the following one:
params['data'] = str(params['data']) response = self.session.post(url=BASE_URL % url, headers=headers, **params)
and everything seems to be working ok.
Maybe I'm completely wrong because I'm not very good at the particularities of unicode and string chars in Python, or the configuration of my system is not ok, but I wanted to check it here and give you a big thank you for the project.
Thanks.

---
Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/7640254-problems-with-some-unicode-characters?utm_campaign=plugin&utm_content=tracker%2F301312&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F301312&utm_medium=issues&utm_source=github).

In 3.X we'll be dropping the support for python 2.7 and move to python 3.6. This should solve the unicode problem, but we'll need to add a test for it.

I've added some tests with emojis and it should be fine now.
https://github.com/vtemian/buffpy/commit/72010f8abdc569c7573f17a6026131417bbd91c6


CTRL+- to decrease font size doesn't decrease from the current font size value

[x] I am on the latest Hyper.app version
[x] I have searched the issues of this repo and believe that this is not a duplicate

OS version and name: Windows 10
Hyper.app version: 1.1.0
Link of a Gist with the contents of your .hyper.js:  None
Relevent information from devtools (CMD+SHIFT+I on Mac OS, CTRL+SHIFT+I elsewhere): None
The issue is reproducible in vanilla Hyper.app: Yes

Issue
Using CTRL+- resizes the font size either from the size on startup, or the value from last font size decrease instead of decreasing from the current font size
Reproduce:
Start hyper > Starts with 12px font size

Press CTRL+(Minus) one time > Reduces fontsize from 12px to 11px

Press CTRL+(Plus) 5 times > Increases fontsize 5 times (the exact number is not visible >12px it seems) but let's assume 16px

Press CTRL+(Minus) one time > Reduces fontsize from 11px to 10px

Can't reproduce this in 1.3.0, still having an issue?

I can reproduce this exact behaviour on vanilla and on all versions I've used (currently 1.4.3).  Windows 10.

I too have the same problem.
Using Windows 10 latest update.
Hyper 1.4.8(stable)

Hey there, please try again with the new Hyper v2 release and open a new issue if the problem stills exists. Thank you!


v3.0.6934.2407 Git-c1579fcd - AV in to ToolStatus then try resize main window if have another saved RebarConfig

v3.0.6934.2407 Git-c1579fcd - AV in to ToolStatus then try resize main window if have another saved RebarConfig
Phenomena:
AV in to ToolStatus then try resize main window if have another saved ProcessHacker.ToolStatus.RebarConfig
Step for respond:

Run PH in to normal window (window size little then full screen size) and unlock main toolbar;
Add to main toolbar any history graphs;
Exit PH for save current config;
Run PH and stretch any history graph;
Double click in to main window title and have AV in to ./plugins/ToolStatus/graph.c on any strings in this list:

Whats strings found in to  ./plugins/ToolStatus/graph.c code?
588: PhGraphStateGetDrawInfo(GraphState, getDrawInfo, SystemStatistics.CpuUserHistory->Count);
660: PhGraphStateGetDrawInfo(GraphState, getDrawInfo,SystemStatistics.PhysicalHistory->Count);
725: PhGraphStateGetDrawInfo(GraphState, getDrawInfo, SystemStatistics.CommitHistory->Count);
790: PhGraphStateGetDrawInfo(GraphState, getDrawInfo, SystemStatistics.IoReadHistory->Count);
and debugger display messages like:

An unhandled exception was raised: read access violation.
SystemStatistics.CpuUserHistory was nullptr.

or any screeched history graph name...
Debugger screenshot is here:

So far, it seems that AV could not reproduce, but I think it is worth checking and learning how it is from others. In v3.0.6934.2407 Git-c1579fcd, an error occurred in KLASS on Win10. If they confirm that they’ve gone, we’ll close them, and if they don’t, then I think we should check more carefully what we’ve fixed on the way.


Write the C and C++ programming standards for Exotic Libraries

Project, Name
Naming Guide
File
Class
Struct
Enum
Function
Error Handling


Update middleware to check for and verify token and redirect users to /login when they are not authenticated

Currently, when the token expires, users are not necessarily redirected to /login unless a 401 error is sent from the backend. The middleware should be checking for access token cookie and verifying it for protected pages.
Also, update the Header to pass the CSRF token in request header

I'm actually going to close this issue for now.
I realized that the way we have set up authentication and authorization currently will not work with the middleware redirecting users to /login page when the access token has expired. This is because the frontend needs to call a refresh endpoint when the backend returns a 401 error. Putting in middleware to redirect users will override the existing functionality.


fix #4094 https://github.com/alibaba/druid/issues/4094 https://aone.a…

…libaba-inc.com/req/4094
修复oracle数据库类型下， over表达式下，在字符串输出下，缺少between关键字问题。

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Scroll zkEVM added

Actually the previous PR is merged, can you rebase the branch to get the latest modifications please ? :)

@MartianGreed merged the changes and refactored the paper


No such file or directory (os error 2)

Getting a No such file or directory (os error 2) after trying to save my first review. Logs show:
 INFO  cargo_crev_reviews::srv_methods_mod::srv_review_mod > srv_review_save

Thank you for trying cargo_crev_reviews. It is still a work in progress.
On my system (Win10+WSL2-Debian) it works without errors.
Can you tell me more about your system, distro, cargo version, cargo-crev version, your crev URL and your crev Id?
Thank you.

I think I found the issue. I managed to get it working after creating my first review through the CLI.

Great !
Probably I need to check if this is the first review and maybe create the appropriate directories if they don't exist.
On my system I already had reviews from before. So I didn't encounter this specific scenario.

Hi, and thanks for the cool project!
I have the same issue, however it appears immediately on startup and the website (/cargo_crev_reviews/index.html) only shows the error: expected value at line 1 column 2
I already have reviews and cargo-crev works as expected.
Starting cargo_crev_reviews in a new cargo package and connecting to the site often crashes the application:
 INFO  cargo_crev_reviews > cargo_crev_reviews server started
 INFO  cargo_crev_reviews::utils_mod > 2022-06-10 23:38:33: sync_in_background_reviews
 INFO  dev_bestia_simple_server      > Server started at http://<IP_ADDRESS>:8182
 ERROR cargo_crev_reviews::crev_mod  > There are no personal reviews yet: No such file or directory (os error 2)
 INFO  cargo_crev_reviews::utils_mod >               0 ms: sync_in_background_reviews
 INFO  cargo_crev_reviews::utils_mod > 2022-06-10 23:38:33: sync_in_background_verify
 INFO  cargo_crev_reviews::utils_mod > 2022-06-10 23:38:33: sync_in_background_yanked
 INFO  cargo_crev_reviews::utils_mod >             356 ms: sync_in_background_yanked
 INFO  cargo_crev_reviews::srv_methods_mod::srv_utils_mod > srv_cargo_tree_project
 INFO  cargo_crev_reviews::utils_mod                      >             861 ms: sync_in_background_verify
 INFO  cargo_crev_reviews::srv_methods_mod::srv_utils_mod > srv_cargo_tree_project
 INFO  cargo_crev_reviews::srv_methods_mod::srv_utils_mod > srv_cargo_tree_project
 INFO  cargo_crev_reviews::srv_methods_mod::srv_utils_mod > srv_cargo_tree_project
 INFO  cargo_crev_reviews::srv_methods_mod::srv_utils_mod > srv_cargo_tree_project
 INFO  cargo_crev_reviews::srv_methods_mod::srv_utils_mod > srv_cargo_tree_project
 INFO  cargo_crev_reviews::srv_methods_mod::srv_utils_mod > srv_cargo_tree_project
thread '<unnamed>' panicked at 'Error handling connection.: Io(Os { code: 32, kind: BrokenPipe, message: "Broken pipe" })', /home/user/.cargo/registry/src/github.com-1ecc6299db9ec823/dev
...
thread 'main' panicked at 'Thread pool worker panicked', /home/user/.cargo/registry/src/github.com-1ecc6299db9ec823
/scoped_threadpool-0.1.9/src/lib.rs:236:13
... [nothing useful in the backtraces]

Version v2022.125.1258 on x86_64-unknown-linux-gnu.


Provide an ability to tree-shake the code but avoid symbol renaming

🚀 Feature request
Command (mark with an x)

[x] build

Description
In order to investigate bundle size issues in a CLI app, it'd be very helpful to have an ability to apply tree-shaking (dead code elimination), but retain symbol names in the output, so that it's easier to figure out which code is retained and why. If I understand correctly, the NG_BUILD_DEBUG_OPTIMIZE doesn't provide an ability to configure ng build in this way.

@AndrewKushnir, are you disabling the cache?
ng config cli.cache.enabled false

@alan-agius4 thanks for the reply! The NG_BUILD_DEBUG_OPTIMIZE flag worked after disabling the cache :)
Just curious: do we take the NG_BUILD_DEBUG_OPTIMIZE flag (and its value) into account when we calculate the cache key?
(closing the ticket since the original issue is resolved)

Just curious: do we take the NG_BUILD_DEBUG_OPTIMIZE flag (and its value) into account when we calculate the cache key?

No, maybe we should.