Custom Metadata Profiles

Hi,
I have been attempting to create my own custom metadata profile. I have created a profile and enabled it in metadata-editor.js, however when I go to upload my custom XML, none of the custom tags are recognized. I was unable to find any information in the wiki regarding advanced metadata customization, other than where the 'My Profile' example is in the source code. Could you point me in the right direction?
Thanks

hi Lewis. Perhaps best to do a webcast sometime.
Editing a profile in geoportal essentially starts with selecting a base implementation. for example ISO 19115/19139. Your metadata type 'extends' that base with your specific XML elements, attributes, domains, defaults, validation rules, etc.
Think of the XML as being built up of classes (like the UML diagrams in the typical ISO/OGC/INSPIRE documentation). The editor code follows that approach. So you may have a class for a free text field or a class for contact information, etc. A good example is the contact info. This returns in metadata in various areas (point of contact, owner, distributor, etc). You'd define the contact info class once for the editor and then reference it from other parts of your editor.
When you reference a class, in the HTML template you can specify what the target XML element needs to be, whether the class is optional and/or can be repeated, etc.
Example:

Here you'll see esri/dijit/.../CI_ResponsibleParty. This means this is one of those classes that exist, but is actually not local to your metadata style. It is automatically fetched by the JS API. If you want to reference a local class you'd have something like this: app/gxe/types/yourtype/.../CI_ResponsibleParty
For the UI there are other types of classes that result in free text fields (esri/dijit/metadata/**form**/iso/GcoElement), drop-downs, date widgets, etc. They will be referenced using the form path.

Hi,
Thank you very much for the thorough and detailed explinaiton, I came across this when delving further into the source, but you have tied it all together very well for me.
Where can I find the webcasts? It may be handy for me to go through them to further increase my understanding. One more question that would help me fit all the pieces together:
When I create these classes, how does the editor know to generate my custom xml? Say my namespace is xyz and I have a specific schema for the types and I would need to have it generate something like
<xyz:identifier>     <xyz:name>         **NAME**    </xyz:name> </xyz:identifier>
How would it know to generate the xml in that way? Apologies if this is blatantly obvious and I am missing the mark; I am quite new to all of this.

hi, we don't have pre-recorded webcast. I would be happy to get on the phone.
the XML structure is derived from the HTML templates while they also define the structure of the editor. so, the editor follows the XML structure. for example, if your XML has multiple sections at the same level, you could use tabs to separate them in the editor:

Within such div you could have nested tab divs, etc.
you'll also see these types of divs:

this declares a single editor element gmd:version that will result in an XML structure like this:
<gmd:version><gco:CharacterString>...</gco:CharacterString></gmd:version>
the target attribute includes the namespace prefix to use

You'll also have something like the MyProfileDocumentType.js that is the basis. In this you would define namespaces (only ones that are not inherited from the parent specification) for your metadata style.
the ISO base profile includes the following snippet:
var oThisClass = declare(DocumentType, {
...
initializeNamespaces: function() {
  this.addNamespace("gmd", "http://www.isotc211.org/2005/gmd");
  this.addNamespace("gco", "http://www.isotc211.org/2005/gco");
  this.addNamespace("srv", "http://www.isotc211.org/2005/srv");
  this.addNamespace("gml", "http://www.opengis.net/gml");
  this.addNamespace("xlink", "http://www.w3.org/1999/xlink");
},
...

If you add an additional namespace with prefix xyz you'd add:
  this.addNamespace("xyz", "http://mydomain/mynamespacepath");

and then in the HTML templates use the target dojo property like so:
data-dojo-props="target:'xyz:mynewelement',label:'My New Element Label'"
Note: only change name spaces and prefixes if absolutely needed. If you stay within the base specification namespaces (like ISO ones above) I would not change their namespace.

While you're in the DocumentType.js you may see functions like these:

beforeInitializeAttribute
afterInitializeAttribute
beforeInitializeElement
afterInitializeElement

These get called when the editor builds for a document. They allow you to override for example the multiplicity of an element, implement that fun 'conditional' requirement (if the value of that element is such, then this element is mandatory), or set default values.

Hi Marten,
Thanks for all of the Info! everything makes a lot more sense now, hope to speak further next week

Hi,
Regarding the conditional requirement and the functions available in the DocumentType.js is it possible according to a selected value from a InputSelectOne element to offer distinct options for a InputSelectMany element? The user selects an option from the InputSelectOne element and according to that selection you than have distinct options for the InputSelectMany element.

I suggest checking out one of the existing profiles. You'll see some approaches where a select one choice is turned into a set of tabs and then within the tab you have the elements specific to that choice.

Profile: INSPIRE Data > Identification > Citation > Unique Resource Identifier
Profile: ISO 19115-2 > Identification > Constraints > Constraints

Before coding this in JavaScript I'd look at using the template approach first.

Thank you so much for the response. I've seen the ChooseElement but unfortunately I have a lot of options for the Choose one element and it would mean to create many tabs... Is there any other option?

We added documentation on creating a custom profile here: https://github.com/Esri/geoportal-server-catalog/wiki/Customize-Metadata-Profiles. closing this ticket.


:robot: Add remote-ops-bof.vm

Automated PR from https://github.com/mandiant/VM-Packages/issues/380 :rocket:

@nos3curity this category should be Information Gathering

similar to #383 should we name this with the tool author? ie "trustedsec-remote-ops-bof"

@day1player changed package name and category. Ready to merge if you are okay with it.


kubernetes mixin should have a namespace-create command, that's an upsert

There should be a feature that implements kubectl create ns <foo> but tests first to see whether it exists and only then creates it if not; else returns success immediately.

@squillace There is already PR in the work: https://github.com/getporter/kubernetes-mixin/pull/20


cannot assign to an element of an array which is returned from a function

I' m doubting about the code below:
package main

func getSlice() []int {
    var a [5]int
    return a[:]
}

func getArray() [5]int {
    var a [5]int
    return a
}

func getPointerToArray() *[5]int {
    var a [5]int
    return &a
}

func main() {
    getSlice()[0] = 1
    getArray()[0] = 1
    getPointerToArray()[0] = 1
}

both "getSlice()[0] = 1" and "getPointerToArray()[0] = 1" are ok for compiler.
but getArray()[0] can not go through.
The go 1.5 compiler give error:
"cannot assign to getArray()[0]"
Is this a problem?if not, Who could tell me why we can't not use the form like above! 3ks!

Questions like this are better addressed by the golang-nuts mailing list, but the short summary is the Go programming language specification says the assignment getArray()[0] = 1 is not allowed.
Assignments: "Each left-hand side operand must be addressable, a map index expression, or (for = assignments only) the blank identifier."
Address operators: "The operand must be addressable, that is, either a variable, pointer indirection, or slice indexing operation; or a field selector of an addressable struct operand; or an array indexing operation of an addressable array."
getSlice()[0] is a slice indexing operation, so it's addressable, so the assignment is valid.
getPointerToArray()[0] is short-hand for (*getPointerToArray())[0], and pointer indirections are addressable, so this is an array indexing of an addressable array.
getArray()[0], however, is an array indexing of a non-addressable array, so the Go compiler is rightfully rejecting the statement as invalid.

See the language spec's part about addressability.
We can move this discussion to the golang-nuts mailing list.


filtering programs for objects that cannot be shown or implemented in the unity executor

How do you implement "filtering programs for objects in the evolving graph executor that cannot be shown or implemented in the unity executor"?
Is that "programs = self._trim_programs_without_images(programs)" in  src/sketch/demo_dataset.py? Then 30K programs becomes 8K after the filtering.
Furthermore, where can I download the demonstration/images in the dataset? I didn't find the link.
Thanks!

To filter programs that cannot be executed, we just run them on virtual home. We filter out any programs that get any error or exception.
For the demonstrations, you will need to generate it on virtual home, for more details, please check here


Wrong JAVA_HOME in java/jre:8-zulu-windowsservercore

If I start a new container using this image:
PS> docker run --rm -it mcr.microsoft.com/java/jre:8-zulu-windowsservercore

Microsoft Windows [Version 10.0.14393]
(c) 2016 Microsoft Corporation. All rights reserved.

C:\>dir %JAVA_HOME%
The system cannot find the path specified.

C:\>echo %JAVA_HOME%
C:\Program Files\zulu\zulu-8

C:\>dir "C:\Program Files\Zulu"
 Volume in drive C has no label.
 Volume Serial Number is 2223-34A0

 Directory of C:\Program Files\Zulu

07/22/2020  08:19 PM    <DIR>          .
07/22/2020  08:19 PM    <DIR>          ..
07/27/2020  04:18 PM    <DIR>          zulu-8-jre
               0 File(s)              0 bytes
               3 Dir(s)  21,168,553,984 bytes free

The Java home contains the directory zulu-8 but it's actually called zulu-8-jre.

Thank you @mehaase for finding a problem. Issue was fixed, try to pull image again


libc++ OSX Mojave

HI,
Having issue pip installing this package.
Installing collected packages: decrunch
  Running setup.py install for decrunch ... error
    Complete output from command /Library/Frameworks/Python.framework/Versions/3.6/bin/python3.6 -u -c "import setuptools, tokenize;__file__='/private/var/folders/fh/d4jkcy7524dbzbhyg_jljdb80000gn/T/pip-install-1ccek1sx/decrunch/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /private/var/folders/fh/d4jkcy7524dbzbhyg_jljdb80000gn/T/pip-record-ygi5dzo2/install-record.txt --single-version-externally-managed --compile:
    running install
    running build
    running build_ext
    building 'decrunch' extension
    creating build
    creating build/temp.macosx-10.6-intel-3.6
    gcc -fno-strict-aliasing -Wsign-compare -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -arch i386 -arch x86_64 -g -Icrunch -I/Library/Frameworks/Python.framework/Versions/3.6/include/python3.6m -c decrunch.cpp -o build/temp.macosx-10.6-intel-3.6/decrunch.o
    warning: include path for stdlibc++ headers not found; pass '-std=libc++' on the command line to use the libc++ standard library instead [-Wstdlibcxx-not-found]
    1 warning generated.

Looks to me like it built just fine. There was a warning that's it?


how do i know when the usb device detach/attach with mobile

To get notification about connected/disconnected devices register broadcast receiver.
var usbReceiver: BroadcastReceiver = object : BroadcastReceiver() {
    override fun onReceive(context: Context, intent: Intent) {
        if (UsbManager.ACTION_USB_DEVICE_ATTACHED == intent.action) {
            val device: UsbDevice? = intent.getParcelableExtra(UsbManager.EXTRA_DEVICE)
            device?.apply {
                // call your method that starts communication with the device
            }
        }
        else if (UsbManager.ACTION_USB_DEVICE_DETACHED == intent.action) {
            val device: UsbDevice? = intent.getParcelableExtra(UsbManager.EXTRA_DEVICE)
            device?.apply {
                // call your method that cleans up and closes communication with the device
            }
        }
    }
}

For more details please follow official documentation.
https://developer.android.com/guide/topics/connectivity/usb/host


--val step gives error if --val-workers* = 1

Steps to reproduce:

run --val with --val-workers-validator 1 and --val-workers-writer 1
this will result in error below:

Process Process-2:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap
    self.run()
  File "/usr/local/lib/python2.7/multiprocessing/process.py", line 114, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/local/lib/python2.7/site-packages/pypeln/process.py", line 335, in _map
    _run_task(f_task, params)
  File "/usr/local/lib/python2.7/site-packages/pypeln/process.py", line 313, in _run_task
    params.stage_namespace.active_workers -= 1
  File "/usr/local/lib/python2.7/multiprocessing/managers.py", line 1023, in __getattr__
    return callmethod('__getattribute__', (key,))
  File "/usr/local/lib/python2.7/multiprocessing/managers.py", line 774, in _callmethod
    raise convert_to_error(kind, result)
RemoteError:
---------------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/multiprocessing/managers.py", line 242, in serve_client
    obj, exposed, gettypeid = id_to_obj[ident]
KeyError: '7fb14f194650'
---------------------------------------------------------------------------
2019-03-28 12:24:25,237 mrtarget.modules.Evidences DEBUG - context teardown
2019-03-28 12:24:25,237 mrtarget.common.EvidencesHelpers DEBUG - flushing elasticsearch indexs

I can't recreate this with the current master - this might have been fixed by updating pypeln to 0.1.8 release recently.
Can we put this aside to be checked again with 19.04 ?

tried on 19.04.5 and seems to be solved now :+1:


Exclude __typename in root and all nested

Hi, I would like to be able to remove __typename from the whole tree. I thought something like *.__typename might work, but it did not :/

In the latest version I was able to use skip: ['*.__*'] to exclude all __typename fields

Workaround described by @dallenbaldwin is absolutely correct way to do that


cant enter the nsh mode

i follow the devguide and enter "screen /dev/ttyACM0 BAUDRATE 8N1"
and it shows a new console. but i cant enter any words.

How to fix it? Thank you in advance!
any help would be appreciated!

Did you replaced the "BAUDRATE" word for the board baudrate in number?
Serial: Pixhawk v1 / Pixracer use 57600 baud
Serial: Snapdragon Flight uses 115200 baud

@d3z0rian
yes

Since this is a VM, there may be issues with accessing the port on the host machine. Not sure how we can help with this directly.

If this still persists, try removing modemmanager, and making sure your user is in the dialout group.


WIP CI build, added nix flake

CI setup was done in https://github.com/roc-lang/roc/pull/4729 on the roc repo for security reasons.


Fix undefined property

PHP Notice:  Undefined property: ThirtyBees\PostNL\Entity\Shipment::$DeliveryTimestampEnd in /home/betech/Desktop/postnl-api-php-tb/src/Entity/AbstractEntity.php on line 142

replaced is_null with empty (fixes undefined property)
updated code example in README to a working one

Thanks a lot for your pull request. Also very nice update for the example.
Just checked the AbstractEntity.php changes. Is empty the way to go? I believe we should allow values like 0 and false as well, just not null and undefined values (these should not end up in the call to the PostNL API). Maybe a combination of isset and is_null would be a better fit?

I’m happy to help.
Agree on that, but if you only want non-null, then isset should be enough? (PHP Manual > Determine if a variable is set and is not NULL.)

Ahh yes, it's exactly what we need here :)
Thanks. Will merge it soon!

Great!
p.s. Well written API, I guess only one on github to support new API keys and REST (exactly what we needed). Keep up the good work! I hope that stable release will come soon.

Merged. Thank you!


Adds support for PatchGuestDriveByID to the FirecrackerClient

Issue #, if available:
#39 : https://github.com/firecracker-microvm/firecracker-go-sdk/issues/39
Description of changes:
The generated clients support it so the wrapper client should support the operation as well.
Not adding the operation to the machine.go as part of this change
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Hello @kshitij8, again, thank you for taking the time to do this! I have another branch that has this implementation, but also makes changes to the Machine structure and adds tests. I am going to go ahead and close this one to create that PR once the other two PRs get merged in.

I hadn't seen an update on the issue in a bit and not having patch support was blocking me from using FirecrackerClient so I decided to do the minimal support for the feature.
Thanks! Good to know that there's a full implementation, I look forward to the PR for the issue.


More defensive input checking for wagtail admin endpoints

Issue Summary
We operate a public facing and open to sign up wagtail instance for cooperative editing of articles. We also have a bounty program. The result is pentesters creating accounts and running their toys against the whole wagtail admin. This results in tens of thousands of exceptions emails like:
...
ValueError at /cms/bulk/labs_cms/customimage/add_to_collection/
Field 'id' expected a number but got '12345\'"\\\'\\");|]*\x00{\r\n<\x00>�\'\'💡'.
...
ValueError at /cms/bulk/labs_cms/customimage/add_to_collection/
Field 'id' expected a number but got '../../../../../../../../../../../../../../etc/passwd'.
...
ValueError at /cms/pages/search/
A string literal cannot contain NUL (0x00) characters.
...

For example wagtail/admin/views/bulk_action/base_bulk_action.py means well, but those 404s are never reached:
    def get_queryset(cls, model, object_ids):
        return get_list_or_404(model, pk__in=object_ids)

Would there be interest to accept patches to make these inputs less naive? If so, what would be the preferred way?

Hey @minusf,
thank you for reaching out. I would suggest submitting PRs grouped by area (e.g. one for image-related things, one for search, on for bulk actions etc)


sourceMappingURL missing in prod using sprockets and esbuild

Thank you for this new gem! I'm trying to get source maps working, I apologize in advance if I misunderstood (I have a limited understanding of front-end tooling).
Source maps do seem to work in our Rails 7 app in development (using sprockets 4.0.2, sprockets-rails 3.4.2, jsbundling-rails 1.0.1 and esbuild 0.14.23): assets:precompile generates a JS bundle with a sourceMappingURL clause at the end. However  they do not seem to work in production: the sourceMappingURL clause is absent in this case.
Because of this we do not have proper Javascript crash reports in our monitoring system.
We have this under package.json's scripts: "build": "esbuild app/javascript/*.* --bundle --sourcemap --target=es2016 --minify --outdir=app/assets/builds". I've tried with both config.assets.debug = false (as suggested) and  config.assets.debug = true in application.rb, but this does not seem to change the situation. Some debug info below (point 3 is problematic).

When running that esbuild command, two files are generated as expected: app/assets/builds/application.js and app/assets/builds/application.js.map, where the last line of the JS file is //# sourceMappingURL=application.js.map.

When running RAILS_ENV=development bin/rails assets:precompile, two files are generated: public/assets/application-cc3245bb241eac905dc4ffd8a5abc8d3d42445e9e1986ea93ba7b267e583f1cf.js and public/assets/application.js-67cdc37aff88978cfa5a2cdba39ef49c3da8d9b6ff16f4c7eca581548009fe0c.map, and the last lines of the JS file are (which seem correct):

//# sourceMappingURL=/assets/application.js-67cdc37aff88978cfa5a2cdba39ef49c3da8d9b6ff16f4c7eca581548009fe0c.map
//!
;

When running RAILS_ENV=production bin/rails assets:precompile, two files are generated: public/assets/application-6c7fc839b49f22a88c3f45c04cde931d8a6801ad0312f478165ac605915c1d55.js and public/assets/application.js-67cdc37aff88978cfa5a2cdba39ef49c3da8d9b6ff16f4c7eca581548009fe0c.map. However the JS file has no sourceMappingURL statement at the end, it ends with //!.

Is there a way to make source maps work with jsbundling-rails and esbuild?

I found that removing: --public-path=assets in the package.json solves everything. I don't know why, I don't even know what is that for.
But it solves it.

@silva96 See #58 for why --public-path=assets is desirable, but it indeed breaks sourcemaps. I've submitted https://github.com/rails/sprockets-rails/pull/515 to fix this in Sprockets.


Allow to work when the associations don't have the revision

Fix #157

@edwines can't you please include a test case for this.
thanks!

@edwines i can't replicate this issue, using a OneToOne like in the issue described.
Can you confirm if this is still any issue?

Yes, I pull the most recent version of the EntityAudit and this issue still exists.
Steps to reproduce:

Create two Tables like Human and Robot (see #157)
Configure the entities in EntityAudit:

simple_things_entity_audit:
    audited_entities:
        - AppBundle\Entity\Human
        - AppBundle\Entity\Robot

Create a Human with a null Robot
Call findRevisionHistory and a NoRevisionFoundException will be thrown

I can confirm this is still an ongoing issue and this PR fixes this. @bendavies can this be reviewed for merge?

This way is not right IMO because the associated property will be null like, it does not exists at all.
But this is wrong, the related property exists, just without revision.
We should fallback to the EntityManager::find method instead.
See https://github.com/simplethings/EntityAudit/pull/227

Closing in favor of #227


Adjust home page search input for mobile

What changed? Why?
Before:

After:

Notes to reviewers
How has it been tested?

🟡 Heimdall Review Status

Requirement
Status
More Info

Reviews

🟡
0/1

Denominator calculation

Show calculation

1 if user is bot
0

1 if user is external
0

From .codeflow.yml

1

Additional review requirements

Show calculation

Max
0

0

From CODEOWNERS

0

Global minimum
0

Max

1

1

1 if commit is unverified
0

Sum
1


Comparing datetime and str columns crashes with TypeError

Current Behaviour
When comparing simple datasets where one has a column with type datetime, and the other corresponding column has type string, compare() crashes.  Interestingly, calling compare on the string data report works, but calling compare on the datatime data crashes (i.e., datatime_data_report.compare(string_data_report) crashes, the other way does not.).
Code to reproduce below, here is the output.

/Users/jk/progs/profile-test/venv/bin/python /Users/jk/progs/profile-test/ydata_bugs.py
Python 3.11.4 (main, Jun 29 2023, 21:37:20) [Clang 12.0.0 (clang-1<IP_ADDRESS>)]
Pandas 2.0.3
ydata_profiling v4.3.1

Summarize dataset: 100%|██████████| 9/9 [00:00<00:00, 42.25it/s, Completed]
Summarize dataset: 100%|██████████| 9/9 [00:00<00:00, 67.19it/s, Completed]
-----
Summarize dataset: 100%|██████████| 9/9 [00:00<00:00, 67.49it/s, Completed]
Summarize dataset:   0%|          | 0/6 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/multimethod/__init__.py", line 315, in __call__
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/summary_algorithms.py", line 68, in inner
    return fn(config, series, summary)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/summary_algorithms.py", line 85, in inner
    return fn(config, series, summary)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/pandas/describe_date_pandas.py", line 34, in pandas_describe_date_1d
    "min": pd.Timestamp.to_pydatetime(series.min()),
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: descriptor 'to_pydatetime' for 'pandas._libs.tslibs.timestamps._Timestamp' objects doesn't apply to a 'str' object

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/multimethod/__init__.py", line 315, in __call__
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/pandas/summary_pandas.py", line 57, in pandas_describe_1d
    return summarizer.summarize(config, series, dtype=vtype)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/summarizer.py", line 42, in summarize
    _, _, summary = self.handle(str(dtype), config, series, {"type": str(dtype)})
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/handler.py", line 62, in handle
    return op(*args)
           ^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/handler.py", line 21, in func2
    return f(*res)
           ^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/handler.py", line 21, in func2
    return f(*res)
           ^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/handler.py", line 21, in func2
    return f(*res)
           ^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/handler.py", line 17, in func2
    res = g(*x)
          ^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/multimethod/__init__.py", line 317, in __call__
    raise DispatchError(f"Function {func.__code__}") from ex
multimethod.DispatchError: Function <code object inner at 0x134307960, file "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/summary_algorithms.py", line 62>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/multimethod/__init__.py", line 315, in __call__
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/pandas/summary_pandas.py", line 99, in pandas_get_series_descriptions
    for i, (column, description) in enumerate(
  File<EMAIL_ADDRESS>line 873, in next
    raise value
  File<EMAIL_ADDRESS>line 125, in worker
    result = (True, func(*args, **kwds))
                    ^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/pandas/summary_pandas.py", line 79, in multiprocess_1d
    return column, describe_1d(config, series, summarizer, typeset)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/multimethod/__init__.py", line 317, in __call__
    raise DispatchError(f"Function {func.__code__}") from ex
multimethod.DispatchError: Function <code object pandas_describe_1d at 0x7fa1d47960d0, file "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/pandas/summary_pandas.py", line 19>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/jk/progs/profile-test/ydata_bugs.py", line 26, in <module>
    compare_ydata(df2, df1)
  File "/Users/jk/progs/profile-test/ydata_bugs.py", line 16, in compare_ydata
    report1.compare(report2)
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/typeguard/__init__.py", line 1033, in wrapper
    retval = func(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/profile_report.py", line 543, in compare
    return compare([self, other], config if config is not None else self.config)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/compare_reports.py", line 339, in compare
    labels, descriptions = _compare_profile_report_preprocess(reports, _config)  # type: ignore
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/compare_reports.py", line 146, in _compare_profile_report_preprocess
    descriptions = [report.get_description() for report in reports]
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/compare_reports.py", line 146, in <listcomp>
    descriptions = [report.get_description() for report in reports]
                    ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/typeguard/__init__.py", line 1033, in wrapper
    retval = func(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/profile_report.py", line 320, in get_description
    return self.description_set
           ^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/typeguard/__init__.py", line 1033, in wrapper
    retval = func(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/profile_report.py", line 251, in description_set
    self._description_set = describe_df(
                            ^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/describe.py", line 72, in describe
    series_description = get_series_descriptions(
                         ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/multimethod/__init__.py", line 317, in __call__
    raise DispatchError(f"Function {func.__code__}") from ex
multimethod.DispatchError: Function <code object pandas_get_series_descriptions at 0x7fa1d47977d0, file "/Users/jk/progs/profile-test/venv/lib/python3.11/site-packages/ydata_profiling/model/pandas/summary_pandas.py", line 60>

Process finished with exit code 1

Expected Behaviour
Should show a comparison and not crash.
Data Description
See below.
Code that reproduces the bug
import sys

import pandas as pd
import ydata_profiling
from ydata_profiling import ProfileReport

print('Python', sys.version)
print('Pandas', pd.__version__)
print('ydata_profiling', ydata_profiling.__version__, '\n')

def compare_ydata(df1, df2):
    report1 = ProfileReport(df1, title='df1', interactions=None, correlations=None)
    report2 = ProfileReport(df2, title='df2', interactions=None, correlations=None)
    report1.compare(report2)

df1 = pd.DataFrame({'a': ['2023-01-17 05:12:40', '2023-01-17 05:02:38']})
df2 = pd.DataFrame({'a': pd.to_datetime(['2023-06-08 07:02:00', '2023-01-05 08:07:00'])})

# Works
compare_ydata(df1, df2)
print('-----')
# Crashes
compare_ydata(df2, df1)

pandas-profiling version
v4.3.1
Dependencies
pandas==2.0.3

OS
MacOS 13.4
Checklist

[X] There is not yet another bug report for this issue in the issue tracker
[X] The problem is reproducible from this bug report. This guide can help to craft a minimal bug report.
[X] The issue has not been resolved by the entries listed under Common Issues.

Hi @jkleint,
Can you share a bit more context please? Based on our understanding, you want to compare 2 datasets with the same variable names, but with different data types identified. Is that correct?

Hi @jkleint,
Can you share a bit more context please? Based on our understanding, you want to compare 2 datasets with the same variable names, but with different data types identified. Is that correct?

Yes.
It's not that I want to, but dirty data happens, and a good tool should do something reasonable besides crash.  The base level would be reporting that they have different types and not trying to compare.  Ideal would be trying to coerce compatible types and do the comparison (or report when that's not possible).
Thanks!

@jkleint I've asked to understand better the use case that you trying to run / solve.
If this is a feature request, then it will be considered as such, if this is something that I can help you with with a workaround, more than happy to provide you one.
Regarding your request, yes dirty data might be expected indeed and we had that into consideration. Nevertheless, there is a very valid reason why this is not supported yet, metrics of 2 different data types are not comparable and for that reason the comparison in the end would not make sense.
In order to overcome the error you can always define the schema of the data prior running the report. This allows you to avoid the errors that are prompted.

I'm building a generic "compare datasets" tool for many data scientists to use.  I want to say "point this tool at your data to see what's different."  I want it to be super simple, one line of code, no knowledge required to use. I do not have control over their data; I don't even see it.  Often it's very dirty; sometimes that means columns with the same names and different types.  If the tool crashes in this case, it's not helpful, and people aren't going to use it.
I know you build your software to high standards, and you'd agree that ideally your software would not outright crash in any case, but handle errors gracefully.  I've shared what looks to me like a bug; I feel the graceful fix is to recognize when columns have incomparable types, note that, and proceed with the comparison.  Then just say in the report that the types were X and Y and so couldn't be compared.  I hope you agree that's reasonable.  Thanks!

I second this. Recently upgraded to ydata-profiling from pandas-profiling and I can't seem to run reports on old data because of this.
It would be nice if it failed gracefully since I think many people use this library in the early stages of data analysis when you have very little idea what your data looks like.  Defining a schema isn't a trivial task (in my case I can have hundreds of columns).
At the minimum it'd be nice if it threw a more helpful error.


Updates for Swift 4

Fixed @objc selector warning for Swift 4 and changed FLT (deprecated) to Float.greatestFiniteMagnitude.

Fixed Markdown for H2's in README.md

@thomaspwang Thanks! Great job!


[1.18.2] Mystical World Charred Wood tree Dynamic Tree has Missing Texture

Attached are screen shots and a log file  incase it is helpful, (note that it will have a crash report in it because another mod causes a fatal error when saving the world, this is unrelated)
This happens with or without rubidium.
Images
https://drive.google.com/drive/folders/1UFMhCkbTqB3NTgyRws-5Zg8_f6Su_Lef?usp=sharing
and if helpful: latest.log
latest.log

Dynamic trees does not add support for other mods in itself. I believe DT support for Mystical World is built-in (on their end) so please report it to them.


Add ability to customize docker image using labels

Thank you for this pull request! Please check this document for how the Jenkins project handles pull requests.

If I understand properly, this allows to configure a job to run using an arbitrary docker image, by using the label defined in slave info as a prefix, and reuse the rest of the SlaveInfo definition.
I don't think this can be merged as is. In my opinion, there should be an opt-in in the slave info to allow this behaviour.

That's a valid point @Vlatombe. Would a checkbox in the Cloud > Mesos-Cloud > Advanced section be suitable and sufficient for this? Default should be disabled and the plugin would check for this property before starting a container.  Please let me know what you think.

@Vlatombe Could you give us some pointers how you envision the opt-in?

Sorry for the delay. The opt-in should be at slave info level in my opinion.


fix: Safer reads on entry fields properties inside getLinks() method for Offline API

Follows #179

I notice forked branches in PRs always fail, because they miss settings defined in the repository (since the fork is based in a new repository):
Setting environment variables from repository settings
$ export CODECOV_TOKEN=[secure]
$ export GH_TOKEN=[secure]
$ export CONTENTFUL_INTEGRATION_MANAGEMENT_TOKEN=[secure]
$ export CONTENTFUL_INTEGRATION_SOURCE_SPACE=[secure]
$ export NPM_TOKEN=[secure]

Would it make sense to change these environment variables to be defined as project settings in Travis CI,  rather than repository settings?

Thanks @yanneves

:tada: This PR is included in version 0.17.4 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


refactor(plugin): make use of native mkdocs.event_priority

use mkdocs event_priority to control the events execution order of this plugin (always last)

FYI @kamilkrzyskow

Do you @ultrabug perhaps have a short explanation why exactly does the plugin mimic the behavior of MkDocs when building alternate languages? Wouldn't it be possible to create a custom mkdocs.yml on_post_build and call the internal MkDocs build procedure from the start all over, and then finally when all of the langues are finished it would copy the files from those separate builds back to the initial one combining it all into one. I'm asking if that's a technical limitation of MkDocs or design choice of the plugin that is currently too deeply developed to refactor it? 🤔
A lot of people use the Material theme with a bunch of different Insiders plugins that could bring their own issues when this plugin needs to "handhold" the process of running events 🤔
As for the event priorities I think that a lot of plugins would choose to have -100 to make sure they're working on the "latests" version of any config, env, etc. 😆 However, it sure helps when they use the default.

As a side-note, after pondering about it over the last 2 days. I will copy some parts of the awesome-pages Test Suite, since it does have a nice method of separating MkDocs builds. https://github.com/lukasgeiter/mkdocs-awesome-pages-plugin/blob/836098293872edda9df4576bd90759c253e1437c/mkdocs_awesome_pages_plugin/tests/e2e/base.py#L86
Still thinking about the cleanest way to introduce this kind of approach to the current testing suite 👌

I'm asking if that's a technical limitation of MkDocs or design choice of the plugin that is currently too deeply developed to refactor it?

MkDocs structure changed quite a lot since I wrote this plugin so lots of design decisions of this plugin come from some constraints of MkDocs 1.2 and of course from my own interpretation and initial suffix only design of the plugin.
More people than I initially thought actually adopted this plugin and I eventually ended up facing major requests such as the folder structure... which is not very intuitive with the initial design of this plugin.
TBH this plugin needs a deeper rewrite of its internal logic to leverage on newer MkDocs structure and take into account the two methods of providing translations.
I have ideas.. time is another story :)
This PR is a quick step into MkDocs newer structure as you can see.


Cannot update username

The field appears to be editable but it does not edit properly. After I clicked save changes, it used the previous one (before update) username to display in profile page but information like firstname and lastname changed very well.

I will look into that issue. Thank you for letting us know!

Don't forget to confirm bugs in google sheets as well. https://docs.google.com/spreadsheets/d/1Lk7dOQYiufLZvKH9MZ1CD7OOeaGz7OjfYnfcPHsTzpw/edit?gid=189073192#gid=189073192

Thank you for you confirmation. This field was suppose to not be mutable in the final product. This was some thing that was left over from the latest iterations of over development. We will push out the updated version soon. Thank you for noticing us!

Then you should make it does not appear as input field at first.

I leave you two solutions.

Make it look more immutable. Especially input field makes users feel that it should be mutable.
Make it mutable.

It is not won't fix.


[CLI]: The cache list command should not list any providers that do not have any cached files.

Currently the libman cache list command outputs is as below which includes providers that have no cached files.
Cache contents:
---------------
unpkg:
    twitter-bootstrap
filesystem:
    (empty)
cdnjs:
    bootstrap
    jquery
    twitter-bootstrap
    underscore.js

It should not include any providers that do not have any cached files.

Duplicate of https://github.com/aspnet/LibraryManager/issues/240.

Closing duplicate


there should be complete dotnet implementation of appium

with sharpAdbClient, xamarin.android and asp.net core, it seems a much better substitute of appium or even xamarin.uitest(lua based)
this is just for question if there is a impl like this.

That's unfortunately outside of the scope of this project.


Added lightning damage listed as Innervate incorrectly.

The flat damage from added lightning support is listed as innervate under calcs tab
https://i.imgur.com/AJnBHRz.png
https://pastebin.com/hbFs5zP7

Oddly enough, this only happens when you have a level 21 Added Lightning Damage.  See an example here:
https://pastebin.com/twV6zdPy

Okay, I've done all the research I can for now, but this is a pretty complicated issue to my layman eyes.
It looks like the issue started appearing with this commit:  https://github.com/openarl/PathOfBuilding/commit/7f0ad904e7241109e5a1af2c8da77088b9a3e63a#diff-4ac32a78649ca5bdd8e0ba38b7006a1e
In Developer Mode, the issue disappears when I refresh with F5 on the Calc screen, and I have to completely create a new build and refresh with F5 in order to see it pop up again.  This suggests a problem with the Added Lightning Damage gem when loaded initially from the skill list, or a problem with the initial character environment on load.  Most of this code is pretty complex and deep within the project, so unless I get some more time I might have to have @Openarl take another look.


Getting  tables.exceptions.HDF5ExtError: HDF5 error back trace

When I tried to run a program by executing python preprocess.py data/smiles_50k.h5 data/processed.h5. it is generating an error.
The detailed error is attached in the image. How to correct this?

Because the files are larger than 50MB, they are stored with git lfs
You need to install git lfs https://git-lfs.github.com/
then run
git lfs get
to download the files

Now it is giving different error when i tried to run the
sudo python train.py data/processed.h5 model.h5 --epochs 20
Using Theano backend.
Traceback (most recent call last):
File "train.py", line 65, in
main()
File "train.py", line 43, in main
model.create(charset, latent_rep_size = args.latent_dim)
File "/home/sachin/vinay/chemistry/keras-molecules/molecules/model.py", line 23, in create
_, z = self._buildEncoder(x, latent_rep_size, max_length)
File "/home/sachin/vinay/chemistry/keras-molecules/molecules/model.py", line 81, in _buildEncoder
return (vae_loss, Lambda(sampling, output_shape=(latent_rep_size,), name='lambda')([z_mean, z_log_var]))
File "/usr/local/lib/python2.7/dist-packages/keras/engine/topology.py", line 585, in call
output = self.call(inputs, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/keras/layers/core.py", line 659, in call
return self.function(inputs, **arguments)
File "/home/sachin/vinay/chemistry/keras-molecules/molecules/model.py", line 68, in sampling
epsilon = K.random_normal(shape=(batch_size, latent_rep_size), mean=0., std = epsilon_std)
TypeError: random_normal() got an unexpected keyword argument 'std'

This is due to a change in the Keras API, the parameter std has been changed to std_dev
Change the code and submit a pull request :)

Yes, I had corrected. I think you are using data and label as same in both train and test (in train.py line n0=54). Why? Also, you are giving the testing data as validation data? Is there any separate program to calculate the accuracy on test data set? I want to know whether the code does a classification or prediction?
Accorsing to me it is a kind of prediction, am i right?

I'm a lurker in this repo - I dont use the train/test code

You're right, the latter should be "data_test". In general, "train_gen.py"
should be used instead, it should be less demanding on your machine.
I wouldn't call an autoencoder or a VAE as a classification or prediction.
Instead, I would call it as representation learning, a la
https://hips.seas.harvard.edu/blog/2013/02/04/predictive-learning-vs-representation-learning/

For the record, if you are using the latest version of TensorFlow with Keras, the API has changed  std => stddev

I encountered the HDF5 exception. The easiest way to resolve it is to checkout / download / replace the data files.

Getting an error, when I tried to run
python preprocess.py data/smiles_500k.h5 data/processed_500.h5
File "preprocess.py", line 85, in
main()
File "preprocess.py", line 72, in main
apply_fn=lambda ch: np.array(map(one_hot_encoded_fn,
File "preprocess.py", line 63, in create_chunk_dataset
chunks=tuple([chunk_size]+list(dataset_shape[1:])))
File "/home/vinay/chemistrytensor/local/lib/python2.7/site-packages/h5py/_hl/group.py", line 105, in create_dataset
dsid = dataset.make_new_dset(self, shape, dtype, data, **kwds)
File "/home/vinay/chemistrytensor/local/lib/python2.7/site-packages/h5py/_hl/dataset.py", line 76, in make_new_dset
if isinstance(chunks, tuple) and (-numpy.array([ i>=j for i,j in zip(tmp_shape,chunks) if i is not None])).any():
TypeError: The numpy boolean negative, the - operator, is not supported, use the ~ operator or the logical_not function instead.

I got the same error, because I didn't download the original datasets through:
python download_dataset.py --dataset zinc12
python download_dataset.py --dataset chembl22
python download_dataset.py --uri http://my-domain.com/my-file.csv --outfile data/my-file.csv
The reason why I skipped it was because an error occurred when I tried to download the data:
AttributeError: module 'urllib' has no attribute 'urlretrieve'
And here is the solution to the "AttributeError":
https://stackoverflow.com/questions/17960942/attributeerror-module-object-has-no-attribute-urlretrieve
I changed the code of "download_dataset.py" a little, and now it works out fine:
import urllib.request
……
urllib.request.urlretrieve(uri, fd.name, reporthook = update)
Hope it helps


[Python] Canonical fixed-shape tensor extension array/type is not picklable.

Describe the bug, including details regarding any error messages, version, and platform.
The fixed-shape tensor extension type does not appear to be picklable. Given that pickling Arrow data is supported in general and is used in Python-centric systems such as Ray, supporting pickling for canonical extension types/arrays seems reasonable.
Reproduction
Extension Type
pickle.loads(pickle.dumps(pa.fixed_shape_tensor(pa.int64(), (2, 2))))

raises the error:
KeyError                                  Traceback (most recent call last)
File .../venv/lib/python3.9/site-packages/pyarrow/types.pxi:4798, in pyarrow.lib.type_for_alias()

KeyError: 'extension<arrow.fixed_shape_tensor>'

Extension Array
tensor_type = pa.fixed_shape_tensor(pa.int32(), (2, 2))
arr = [[1, 2, 3, 4], [10, 20, 30, 40], [100, 200, 300, 400]]
storage = pa.array(arr, pa.list_(pa.int32(), 4))
tensor_array = pa.ExtensionArray.from_storage(tensor_type, storage)
pickle.loads(pickle.dumps(tensor_array))

raises the ~same error:
KeyError                                  Traceback (most recent call last)
File .../venv/lib/python3.9/site-packages/pyarrow/types.pxi:4798, in pyarrow.lib.type_for_alias()

KeyError: 'extension<arrow.fixed_shape_tensor>'

During handling of the above exception, another exception occurred:

ValueError                                Traceback (most recent call last)
Cell In[13], line 1
----> 1 pickle.loads(pickle.dumps(tensor_array))

File .../venv/lib/python3.9/site-packages/pyarrow/types.pxi:4800, in pyarrow.lib.type_for_alias()

ValueError: No type alias for extension<arrow.fixed_shape_tensor>

Environment

pyarrow 12.0.0
Python 3.9
MacOS

Possible Solution
It seems like we might be able to implement __reduce__ on FixedShapeTensorType such that it uses the __arrow_ext_serialize__ serialization protocol? E.g.
def __reduce__(self):
    return type(self).__arrow_ext_deserialize__, (self.storage, self.__arrow_ext_serialize__())

Component(s)
Python

Thank you for the issue @clarkzinzow!
You are correct. I think it is reasonable to implement __reduce__  method as you suggested.
Are you interested in making a PR with the proposed solution and a test for it?

It seems like we might be able to implement __reduce__ on FixedShapeTensorType such that it uses the __arrow_ext_serialize__ serialization protocol?

We might even be able to put this on the base ExtensionType class, so that every extension type implementation automatically has this implemented (since this should be generic).
The reason for the current error message is that it falls back to the base class DataType reducer which essentially pickles the string repr of the type (which is overridden by many type subclasses):
https://github.com/apache/arrow/blob/f6e447944f2a2ab108d5971daf351b7443bc96fb/python/pyarrow/types.pxi#L225-L226


Mismatch between icon Cloudy -> Mostly Cloudy at night

On the  left the correct one.

Usually Cloudy is only a cloud mostly cloudy 2 clouds
I remove one cloud from mostly cloudy, do you think should be bigger?
As a small icon look ok in the button not so much

I'm not entirely sure I understand the issue... :) But I slightly improved some icons by centering them. Better?

The condition Cloudy was associated to the icon Mostly cloudy at night. I have caught this error because a moon appeared in my forecast. Unless there is an eclipse in the next few days something  was totally wrong.
I add a Cloud opposite the two cloud of mostly cloudy (this is the convention). As always it needs improvement.

Ah, right. I saw that, too. I did some small changes to the single cloud icon. A bit light, vertically centered and reusing the cloud path as a shadow. Plus a slight additional hump at the button. You think it's OK now or do you have another idea?

Looks awesome!


Incorrect behaviour for SPI Slave in mode 3 on esp32 (non-dma) (IDFGH-6011)

esp-idf uses these values for spi slave mode 3, as specified in the reference manual:
        hw->pin.ck_idle_edge = 0;
        hw->user.ck_i_edge = 0;
        hw->ctrl2.miso_delay_mode = 1;
        hw->ctrl2.miso_delay_num = 0;
        hw->ctrl2.mosi_delay_mode = 0;
        hw->ctrl2.mosi_delay_num = 0;

This results in mosi being sampled during the launch edge, which is mentioned in the slave driver documentation and can be confirmed by altering mosi_delay_num, but this behaviour is not mentioned in the reference manual
The following values:
>       hw->pin.ck_idle_edge = 1;
>       hw->user.ck_i_edge = 1;
        hw->ctrl2.miso_delay_mode = 1;
        hw->ctrl2.miso_delay_num = 0;
        hw->ctrl2.mosi_delay_mode = 0;
        hw->ctrl2.mosi_delay_num = 0;

Appear to behave as expected, with data shifted on the launch (falling) edge and sampled on the latch (rising) edge
Not submitting a patch as it's unclear if this is correct; Ideally the reference manual would be updated to clarify how the various settings work, though i imagine this is a fairly low priority issue
The spi master and protocol involved (specifically, a gameboy color link port) requires 8 bit transactions; As a result no testing has been done with dma enabled

@nx518 the spi examples use dma by default, might be worth trying without dma as cpha=1 modes appear to have some strangeness when used with dma
Without a timebase, the cs setup time looks a bit short; As @Icarus113 suggests in #7825 setting cs_ena_pretrans and cs_ena_posttrans may help
Your 3rd example also looks like it should work, if not you can it by setting miso_delay_num

Hi, I found the same problem with the SPI slave in mode 3.
It took me a while to figure out that both the user manual and the esp-idf configuration file, spi_ll.h, were wrong.
In order not to modify the latest version of Expressif, I decided to make an amendment directly to my code and set the two bits explicitly.
if (slvcfg.mode == 3)
{
    REG_SET_BIT(SPI_PIN_REG(spi_config->rcvHost + 1), SPI_CK_IDLE_EDGE); // As 'hw->pin.ck_idle_edge = 1;'
    REG_SET_BIT(SPI_USER_REG(spi_config->rcvHost + 1), SPI_CK_I_EDGE);   // As 'hw->user.ck_i_edge = 1;'
}

Now it does what it should.


Blocker - duplicate repo URLs from different files.

#66 showed that leapp complains if duplicate repo URLs exist. We want to detect and block on this.

Given #66 fixes this, I'm inclined to close this until we have a real world known problem with this.


Runing Time

Hello! I am a newbie in NLP. Thank you very much for the inspiration from your outstanding work! I got a warning that the lower version might lead to slower running speed. I would like to know how long it takes to run a dataset, so that I can better choose and install the versions of software and hardware. Looking forward to your response!

Hi, thank you so much for your question.
The running time of each dataset/task depends on the size of the training data. For large datasets like MNLI, QQP, and QNLI, which have over 100,000 training examples, it often takes longer to train the model for optimal performance, potentially exceeding 10 hours on a single RTX 3090 GPU. This duration assumes no specific speed-enhancing training techniques are applied. Training times are shorter for datasets with fewer examples. In the few-shot learning setting, the training time is typically not very long, but we need to fine-tune the model on the source task before applying it to the target task, which introduces some additional training time.
In addition, we perform an exhaustive hyperparameter search for two learning rates, which introduces additional training costs. However, we will enjoy low memory and time costs during the inference.

Thank you for your  help!


DocsArchive-<IP_ADDRESS>Auto archive content

Auto archive content from https://github.com/OPS-E2E-PPE/docs-archive-test-source

Docs Build status updates of commit 303466d:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

:x:Error

Details

[Error]

Cannot sync git repo to specified commit because branch Release_Archive_master_2020-05-16-04-14-13 has been deleted or has been force pushed: fatal: couldn't find remote ref refs/heads/Release_Archive_master_2020-05-16-04-14-13

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Add an include path for go tool cgo for  vendored c libs

What version of Go are you using (go version)?

$ go version
go version go1.14 linux/amd64

Does this issue reproduce with the latest release?
Yes
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
GO111MODULE=""
GOARCH="amd64"
GOBIN=""
GOCACHE="/home/jpoole/.cache/go-build"
GOENV="/home/jpoole/.config/go/env"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOINSECURE=""
GONOPROXY=""
GONOSUMDB=""
GOOS="linux"
GOPATH="/home/jpoole/core3:/home/jpoole/core3/plz-out/go"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/opt/tm/tools/go/1.14/usr/go"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/opt/tm/tools/go/1.14/usr/go/pkg/tool/linux_amd64"
GCCGO="gccgo"
AR="ar"
CC="cc"
CXX="g++"
CGO_ENABLED="1"
GOMOD=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build291593539=/tmp/go-build -gno-record-gcc-switches"

What did you do?
I'm trying to compile confluent kafka which has a dependency on librdkafka. We compile librdkafka ourselves and I'm trying link against that. We're using go install as so:
$ GO111MODULE="off" go install github.com/confluentinc/confluent-kafka-go/kafka
third_party/go/src/github.com/confluentinc/confluent-kafka-go/kafka/00version.go:24:10: fatal error: 'librdkafka/rdkafka.h' file not found

I get something similar when invoking cgo directly:
$ go tool cgo third_party/go/src/github.com/confluentinc/confluent-kafka-go/kafka/00version.go
/tmp/plz_sandbox/third_party/go/src/github.com/confluentinc/confluent-kafka-go/kafka/00version.go:24:10: fatal error: 'librdkafka/rdkafka.h' file not found
#include <librdkafka/rdkafka.h>
         ^~~~~~~~~~~~~~~~~~~~~~
1 error generated.

I've tried passing build flags to go tool cgo through -gccgoflags though I'm not sure which flags to use. I've tried adding -Ithird_party/cc/librdkafka and -isysetem third_party/cc/librdkafka etc. but I don't think go tool cgo respects these.
What did you expect to see?
I need a way to tell go tool cgo (or go install) about system include directories to look in our vendored directory for #include <librdkafka/librdkafka.h>
What did you see instead?
There don't appear to be any build flags I can pass to do this.

Does CGO_CFLAGS work for your use-case?
(See https://golang.org/cmd/cgo/#hdr-Using_cgo_with_the_go_command and https://tip.golang.org/cmd/go/#hdr-Environment_variables.)

  Both are documented at https://golang.org/cmd/cgo.

Ah thanks a lot! I was setting that to a relative path and it wasn't working. Using an abs path works great!


Observe other games

When two players are playing, and you're not one of them, it would be nice to have an observe feature so that you can watch while they are playing

@Zomis I don't think this realistically should be under 0.6, probably more 0.7 or even 0.8 when we focus more on the GUI and UX, thoughts?

Agreed. Postponing until 0.8.


Exponentiation operator

The exponentiation operator (**) doesn't seem to be supported, even when ES6 is enabled. The online linter at http://jshint.com/ has the same problem. For reference, I'm using 2.9.5 and Node 8.9.0.
Here's a super simple sample:
const x = 2 ** 8;

I'm getting the following errors on this:
Expected an identifier and instead saw '*'.
Missing semicolon.
Expected an assignment or function call and instead saw an expression.

This operator is supported on all modern browsers and frameworks.
See: http://kangax.github.io/compat-table/es2016plus/

Hi there, @thany. If you search this project's issue tracker for the word "exponentiation", you'll find that we already have an issue to track this feature request--see gh-2602. So I'm going to close this as a duplicate. Good news, though: the feature has been implemented and is due out in the next minor release of JSHint!


add CLI options to exclude files

Resolves #547

          1 Warning

:warning:
Big PR

  Generated by :no_entry_sign: Danger

need to fix dependencies update as there are issues with SPM now


cliffsnotes is broken

https://github.com/manestay/novel-chapter-dataset/blob/4c4e3a8dd0c3ef08e14e251ead5e82f5ea62d9a7/scraping/cliffsnotes_scrape.py#L24
The link to the books list shows only the books starting with 'A'. Therefore a lot of books are not scraped.
For me the link https://www.cliffsnotes.com/literature%3Ffilter=ShowAll&sort=TITLE (the ? is replaced with %3F) worked instead.

Hi dominik-schwabe, just seeing this issue now. You're right, the link was out-of-date. I've added a new commit with your fix -- really appreciate it!

It seems CliffsNotes updated their site, so that the correct link is now https://www.cliffsnotes.com/literature?filter=ShowAll&sort=TITLE, and the %3F doesn't work anymore.


Remove np package

So after looking into the np package regarding the unexpected push to master it did from the previous release, it is not exactly clear how that issue occurred. Also the extendibility of the package seems lackluster with respect to having the scripts draft a release pr and lerna integrations don’t look as feasible. I think from a security standpoint, it’s worth removing the package and finding a better alternative at a later date. Since the current script flow relies on branch or tag options to create npm releases - not even addressing unexpected commits to the master branch, we could actually save ourselves an overly complex release process by just going back to npm.

In removing this package, are you going to make a follow up PR where you set up releases to use npm once again?

@kenyaplenty From how we publish using npm, there aren't any additional bits of code to add to kick off a publish/release process. This update just reverts us back to having to use npm publish after creating a release pr.


Onyx Boox Nova3 Color

Sending strings for Ony Boox Nova3 Color
strings.xml.txt

Thanks for your strings! Now they are verified and merged.


Remove access to chainstate database without a transaction

Less macros, more responsibility.

Just a quick first pass

Pushed all fixes to the issues pointed out.


Add Muted by default Garbage Collector

Adding Garbage Collector which is collecting all <none>:<none>(dangling) Images after a build to prevent storage overflow.
Garbage Collector is muted by default and can be unmuted during debugging Sessions.
How to test:

Run your test project with dockerize sometimes to create <none>:<none> images
Checkout this branch in your local dockerize repo
re-install dockerize
run <<cli_name>> docker run -b to run and build
afterwards you should have 0 <none>:<none> images

Codecov Report

Merging #91 (a1ff5a9) into main (10f2c8f) will decrease coverage by 3.09%.
The diff coverage is 0.00%.

:exclamation: Current head a1ff5a9 differs from pull request most recent head b170f35. Consider uploading reports for the commit b170f35 to get more accurate results

@@            Coverage Diff             @@
##             main      #91      +/-   ##
==========================================
- Coverage   39.19%   36.11%   -3.09%
==========================================
  Files          11       12       +1
  Lines         199      216      +17
==========================================
  Hits           78       78
- Misses        121      138      +17

Impacted Files
Coverage Δ

lib/src/docker/collect_garbage.dart
0.00% <0.00%> (ø)

lib/src/docker/create_image.dart
0.00% <0.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


 Or some libraries are not being linked. But, I can't figure out how which library has to be linked and how.
Originally, I wanted to install PAL2 in a virtual environment. Everything went smoothly but when I tried to import libstempo, I got undefined symbol error.
I was able to run and import libstempo in my original environment just fine. I think there is some library not being found/linked when I do it in that virtual environment.
Can you shed some light on this?
Traceback (most recent call last):   File "<string>", line 1, in <module>   File "/home/shining/anaconda2/envs/pal2_conda/lib/python2.7/site-packages/libstempo/__init__.py", line 8, in <module>     from libstempo.libstempo import * ImportError: /home/shining/mega/PDA/lib/libtempo2.so.2: undefined symbol: omp_get_thread_num

This is actually a problem with the tempo2 library, not libstempo. Recent versions use openmp, so you need to compile tempo2 with something that supports it. On the Mac, I use Homebrew-installed llvm (brew install llvm) and then do (export CC=/usr/local/opt/llvm/bin/clang; export CXX=/usr/local/opt/llvm/bin/clang++) before configuring tempo2. If you have a recent gcc through Homebrew or Macports, that could work also. There may be also compilers available through Anaconda, I’m not sure.
 Or some libraries are not being linked. But, I can't figure out how which library has to be linked and how.
Originally, I wanted to install PAL2 in a virtual environment. Everything went smoothly but when I tried to import libstempo, I got undefined symbol error.
I was able to run and import libstempo in my original environment just fine. I think there is some library not being found/linked when I do it in that virtual environment.
Can you shed some light on this?
Traceback (most recent call last): File "", line 1, in  File "/home/shining/anaconda2/envs/pal2_conda/lib/python2.7/site-packages/libstempo/init.py", line 8, in  from libstempo.libstempo import * ImportError: /home/shining/mega/PDA/lib/libtempo2.so.2: undefined symbol: omp_get_thread_num
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub https://github.com/vallis/libstempo/issues/16, or mute the thread https://github.com/notifications/unsubscribe-auth/AAeEsEi7Z_5FwODDDwKk04QAN17baxsaks5sGirggaJpZM4OB_YC.

Closing this issue.


📖 docs: generate a gitops template repo for mgmt and workload clusters

/kind documentation
Describe the solution you'd like
[A clear and concise description of what you want to happen.]
Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]

Solved with #128


1.1.1

Published new version

Coverage remained the same at 99.639% when pulling 81ec2dc7f99155e8e2e46511e6aa1229e2a4952d on 1.1.1 into 5c5fc908608df0b6b502332af4f141759f955b04 on master.


Fix integer overflow in icelake utf16 validate functions

This fixes #431

I am going to merge right away because the fix cannot create trouble.


Improve our pull diagnostics delegation to other language servers

Right now we delegate pull diagnostics to Roslyn and Web Tools, but in a pretty naive way. Pull Diagnostics has a concept of "previous result", whereby if diagnostics hasn't changed, then a server doesn't need to respond with all of the data about them. We currently do not deal with this, so whilst individual servers could still cache their state as appropriate, we are essentially forcing them to serialize all of it every time.
What we need to do is maintain our own per-server dictionary of previous result IDs to previous results, and when, for example, we request diagnostics from Roslyn we send the last result ID they sent to us, and that way if they don't have anything new to add, they can respond simply with that same ID. We need to do the same with Web Tools, and then importantly we need to aggregate those two pieces of information together when we respond to the client, so that if any delegated server has new information to report, we report that new information and the last known information from the other langauge server.

Duplicate of https://github.com/dotnet/razor/issues/8454 because I don't remember what I had for breakfast, let alone what issues I've previously logged.


Added description

added description to readme files

Kindly check the news version of README.md file and update it accordingly

Java String Readme is fixed and the Variable and Data Types documentation in the main branch is not better than the one I committed so maybe merge it.

There are two conflicts resolve them i will merge it

Still some conflicts

No conflicts anymore

Congratulations @jmrchelani  your PR has been merged

thanks


Crash report

MC/F 1.12.2/2613
Just clobbered a small green slime, game froze. Checked report, think it's yours - apologies if not.
https://pastebin.com/J2PasU6a

Yep, its mine.  Dupe of [#232].  Thanks for letting me know!


Executing system commands results in error

Hi,
When executing certain, not all, system command (see screenshot) results in an error. For example setting the exposure.

Through the web interface directly in Octoprint they work fine. The system command for stopping and starting the video stream works just fine, strangely enough.
It is the same on both my (physical separate) Octoprint instances.
This is with the latest OctoPod v3.14 build 3, the previous had the same issue, not sure with earlier releases.

Hi @TheLion,
I think the problem is the % that appears at the end of the action. You can keep the % in the name but try removing it from the action and let me know if that worked. For some reason OctoPrint is encoding the % differently than expected.
Thanks,
Gaston

I think the problem is the % that appears at the end of the action. You can keep the % in the name but try removing it from the action and let me know if that worked. For some reason OctoPrint is encoding the % differently than expected.

I will try that and let you know, but it has always worked like this. Also  through Octopod.

Thanks Martijn! That last piece of information helped me fixed it (i.e. that used to work before). I fixed it and also found same problem downloading or deleting timelapse files.
Gaston

New version is out. Please upgrade and let me know how it goes.
Thanks
Gaston

New version is out. Please upgrade and let me know how it goes.

Just got a notification from TestFlight ;-)
It works like a charm! Thanks!


Show possible fields on invalid "."

If you write a.b and b is a field that does not exist. You will have a suggestion like "did you mean ...". This is useful, but that suggestion is not always correct. This diff keeps that suggestion, but also list all the fields that are accessible, directly in the error message.

LGTM.
One tangential remark: do we really need all the String.upper/String.uc/String.uppercase aliases?

Probably not.


MSID: 96129 Version: 2 DOI: 10.1101/2<IP_ADDRESS>0536

MSID: 96129
Version: 2
Preprint DOI: https://doi.org/10.1101/2<IP_ADDRESS>0536
Step 1. Awaiting reviews
Editorial to post reviews via hypothesis
Useful links:

DocMap: https://data-hub-api.elifesciences.org/enhanced-preprints/docmaps/v2/by-publisher/elife/get-by-manuscript-id?manuscript_id=96129
New model tracking: https://docs.google.com/spreadsheets/d/1_fHaoOy7hjyocptKtVJRijeNpUY4hBS7Ck_aVmx6ZJk/
Reviews on sciety: https://sciety.org/articles/activity/10.1101/2<IP_ADDRESS>0536

For trouble shooting (e.g. no Docmaps available):

DocMap issue addressing: https://miro.com/app/board/uXjVNCwK6EI=/
Explore DataHub DocMaps API: https://lookerstudio.google.com/reporting/4c2f0368-babb-4beb-b5b3-497e7e7b0f08/page/ejphD
Unmatched submissions and preprints: https://lookerstudio.google.com/u/0/reporting/9f86204f-3bf7-477c-9b18-5c5ef141bf69/page/p_gxi57ha93c
Unmatched manuscripts spreadsheet: https://docs.google.com/spreadsheets/d/15QcK8w-ssB7109RQEDtFpJPZ0J5HTGxoHa_2TtpMBbg/edit#gid=1336081641

Step 2. Preview reviewed preprint
Production QC content ahead of publication
Instructions:

QC preview: https://prod--epp.elifesciences.org/previews/96129v2
Update ticket with any problems (add blocked label)
When QC OK, add QC OK label to ticket and add publication date and time to https://docs.google.com/spreadsheets/d/1amAlKvdLcaDp5W8Z8g77NmkwbMF5n_u89ArSqPMO8jg
Move card to next column
(At end of the day post link in #enhanced-preprint and ask for PDF to be generated)

Useful links:

Preprint DOI :  https://doi.org/10.1101/2<IP_ADDRESS>0536
Confirm reviews returned by EPP: https://prod--epp.elifesciences.org/api/reviewed-preprints/96129/v2/reviews
To update the MECA path in the docmap: https://docs.google.com/spreadsheets/d/1mctCQuNFBjSn97Lihy7_vBO6z7-N-oqyLv4clyi6zHg

Step 3: Awaiting search reindex
This step adds the reviewed preprint to the homepage: https://elifesciences.org
The search reindex is triggered once an hour. We need the reviewed preprint to be indexed as the search application serves the journal homepage.
Useful links:

Jenkins pipeline to reindex search can be triggered sooner or monitored here: https://alfred.elifesciences.org/job/process/job/process-reindex-reviewed-preprints/

Step 4: Published! PDF requested
Waiting for PDF to be generated
Useful links:

PDF tracking: https://docs.google.com/spreadsheets/d/106_XeDjmuBae7gexOTNzg60lapeqjl2aRn9DzupGyS8/

Step 5: Introduce PDF to data folder and git repo
Upload PDF to relevent folder in git repo https://github.com/elifesciences/enhanced-preprints-data/
Step 6: Done!

[ ] Kettle is on!

warn: [mixed-citation-other-publication-flag] mixed-citation in reference (id=c12) has a publication-type='other'. Is that correct?
error: [junk-character-presence-3] p element contains a junk character '□' which should be replaced or deleted.


[nextra-theme-docs] Normal Search height overflow

Problem:
When using normal search (not flexsearch) and having a long list of result it will overflow through the page height (occured on view-port of tablet- desktop)
Solution:
Apply the same CSS Rule from flexsearch (.nextra-search.nextra-flexsearch ul) to (.nextra-search ul)
overflow: auto;
min-height: 100px;
max-height: min(calc(100vh - 5rem - env(safe-area-inset-bottom)),400px);
max-width: min(calc(100vw - 2rem),calc(100% + 20rem));

will be available in next beta


ReactNativeModules.com

Hey Guys,
Just wanted to share a site I put together last night http://reactnativemodules.com.  I was super impressed at how many react native modules have been built in such a short time and I thought it would be nice to have a community driven searchable directory.  I could use your help with adding any I'm missing.
Am I missing any?

Thanks @wootwoot1234 Great work!

Nice! You should also look at http://react.parts which is in a similar vein

@wootwoot1234 - thanks for this! Can we close this issue?

Awesome.  How are things registered? Manuall?
JG
301.785.6030 :: @moduscreate
:: sent from my mobile device ::

On Apr 4, 2015, at 12:21, wootwoot1234<EMAIL_ADDRESS>wrote:
Hey Guys,
Just wanted to share a site I put together last night http://reactnativemodules.com. I was super impressed at how many react native modules have been built in such a short time and I thought it would be nice to have a community driven searchable directory. I could use your help with adding any I'm missing.
Am I missing any?
—
Reply to this email directly or view it on GitHub.

@jaygarcia  Modules can be added by anyone.  Right now I'm just keeping an eye on github for new repositories.  Let me know if you have any ideas on where else to look.


HOL 1 missing command di Exercise 7 (Node)

Hi.
I think there is a missing command there. Written:
sudo apt-get git

It should be
sudo apt-get install git

Same issue in the Java HOL1


Update version to 0.5.5

Codecov Report

Merging #750 into master will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master     #750   +/-   ##
=======================================
  Coverage   98.98%   98.98%
=======================================
  Files         256      256
  Lines       13988    13988
=======================================
  Hits        13846    13846
  Misses        142      142


Cannot Login in?

$ instascrape login
Choose Account

(1) + Login New Account
choice> 1
Username: XXXXXXXX
Password:
Traceback (most recent call last):
File "/usr/local/bin/instascrape", line 11, in
load_entry_point('instascrape-ax==1.1.0', 'console_scripts', 'instascrape')()
File "/usr/local/lib/python3.7/site-packages/instascrape_ax-1.1.0-py3.7.egg/instascrape/cli.py", line 637, in main
File "/usr/local/lib/python3.7/site-packages/instascrape_ax-1.1.0-py3.7.egg/instascrape/cli.py", line 212, in login
File "/usr/local/lib/python3.7/site-packages/instascrape_ax-1.1.0-py3.7.egg/instascrape/instascraper.py", line 122, in login
KeyError: 'authenticated'

Any suggestion?

Hi @andy91129,
Try disabling the two-factor authentication if it is enabled.
InstaScrape does not support 2FA currently. I will try to implement this if I have time.
Thanks for the issue!


Where does this cache stores data?Is there any way to persist data even after refresh?

Hi,

Is there anyway to persist data even after page refresh?

Where does this cache stores data as I couldn't find it in browser cache?

I have worked this way but its not working.

Can you tell me whats the issue in this as it shows cacheBuster$ undefined when getUser() is called.

export class UserService {
cacheBuster$ = new Subject();
URL="http://localhost:8030/users/";
constructor(private httpClient:HttpClient) { }
@Cacheable({
cacheBusterObserver: this.cacheBuster$.asObservable()
})
getUser(id:number){
return this.httpClient.get(this.URL.concat(getUser/${id})).pipe(tap(data=>{
this.cacheBuster$.next(data);
}));
}
@CacheBuster({
cacheBusterNotifier: this.cacheBuster$s
})
updateUser(id:number){
return this.httpClient.put(this.URL.concat(updateUser/${id}),{});
}

Is there anyway to persist data even after page refresh?

Yes, use DOMStorageStrategy. Find more about it in the readme.

Where does this cache stores data as I couldn't find it in browser cache?

The default storage strategy is InMemoryStorageStrategy which stores everything in-memory through a closure.

Can you tell me whats the issue in this as it shows cacheBuster$ undefined when getUser() is called.

Typescript decorators are static and they can't refer anything from the instance. That said, you need to take our your cache buster from the class and put it somewhere outside of it.
Foor example const cacheBuster$ = new Subject();

Hy Thanks. It worked.
I got some more issues.
I agree with this.The default storage strategy is InMemoryStorageStrategy which stores everything in-memory through a closure.

But where I can find the data? In disk or at any other place?can you specify path where I can find data?

Also, DOMStorageStrategy worked for me.Thanks for that.

Can I update cache data if it get changed ? Like in case of redis cache on server side, I am able to update cache data if user tries to update data.

For now in updateUser(id:number) method,I am deleting data from cache,It will be much better if somehow I am able to update data in cache.That will increase performance more.
@Cacheable({
maxCacheCount: 2,
cacheBusterObserver: cacheBuster$.asObservable()
})
getUser(id:number){
return this.httpClient.get(this.URL.concat(getUser/${id}));
}
@CacheBuster({
cacheBusterNotifier: cacheBuster$
})
updateUser(id:number){
return this.httpClient.put(this.URL.concat(updateUser/${id}),{});
}

But where I can find the data? In disk or at any other place?can you specify path where I can find data?
There isn't a way to find the data for the InMemoryStorageStrategy.
For the DOMStorageStrategy, you will normally find it under the CACHE_STORAGE localStorage key.

Thanks @angelnikolov .


[Bulk actions librarians] MVP batch upload records

Story
Minimum viable batch upload for records.
Feedback welcome. Find more context below under "Case".
Based on the decision made in https://github.com/ugent-library/biblio-backoffice/issues/1069 – we decided not to create a terminal interface for librarians to do bulk operations.
Wireframes – feedback welcome
Location: in "Batch", below "Batch add projects"

Normal state:

fill out record type TBD
record in JSON
Would be good to have an example for datasets and publications (TBD) in json?

Error state:

Success state:

Scaffolding in code can be found in this branch:
https://github.com/ugent-library/biblio-backoffice/tree/feature/batch-import

Case
To make this an end-to-ed valuable case, we can use the alternative identifiers for datasets as a first step.
Problem statement value for researchers and university

Different faculties use different platforms to deposit their datasets. This results into different identifiers.

There are a lot of identifiers. Connecting and mapping them all with result into a lot of work and maintenance.
Some identifiers are not fully grown. The market still needs to stabilise.
There are not a lot of trusted aggregators in the market we can use.

The temporary solution: manual import of datasets.

This goes into the idea that researchers would never start from 0 in the future.

Opportunity

We can, as a university, support researchers by already exploring the web and find relevant datasets.
We could do this by bulk uploading those datasets for them (in json or excel, mapped on our data structure), so they do not have to start from 0.

Future

We can use the "Plato import case" to turn this into a better experience
We can be ready for a future where we only use trusted parties and link to their information from our platform, if we log those identifiers already.

Technical value
We can call this a "good excuse" project to make sure we can do asynchronous (bulk) actions that take a long time to complete, and you can navigate away while the job completes.

"Add project" is already, right?

@nicolasfranck Yes, see https://backoffice.bibliotest.ugent.be/publication/batch for other options as well. This is a separate feature.

We will for now ask for examples first.

Tracked in https://github.com/ugent-library/biblio-backoffice/issues/1099


Sort using options

Resolves #76

Codecov Report

Merging #89 (bb8c894) into master (c964428) will decrease coverage by 0.18%.
The diff coverage is 0.00%.

@@             Coverage Diff              @@
##             master      #89      +/-   ##
============================================
- Coverage     68.69%   68.51%   -0.19%
  Complexity      434      434
============================================
  Files            77       77
  Lines          1476     1480       +4
  Branches        154      155       +1
============================================
  Hits           1014     1014
- Misses          410      414       +4
  Partials         52       52

Impacted Files
Coverage Δ
Complexity Δ

...java/seedu/address/logic/commands/SortCommand.java
0.00% <0.00%> (ø)
0.00 <0.00> (ø)

.../seedu/address/logic/parser/SortCommandParser.java
0.00% <0.00%> (ø)
0.00 <0.00> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c964428...bb8c894. Read the comment docs.


Drs Gully System

Description
Please include a summary of the change and which issue is fixed. List any dependencies that are required for this change.
Fixes #914
Replace #914  with the issue number which is fixed in this PR
Have you read the Contributing Guidelines on Pull Requests?

[x] Yes
[ ] No

Type of change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update
[ ] Documentation Update

Checklist:

[x] My code follows the style guidelines(Clean Code) of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have created a helpful and easy to understand README.md
[x] My documentation follows Template for README.md
[x] My changes generate no new warnings
[x] I have added tests/screenshots(if any) that prove my fix is effective or that my feature works.

Also, look at these logs to pass the test: https://deepsource.io/gh/avinashkranjan/Amazing-Python-Scripts/run/13a5e64f-5c30-4491-ba8d-4459b0d1efe6/python/

@Ayush7614 updates on this?

@Ayush7614 Will you update this PR today?

PR and issue closed due to no response from participant side


unable to add a tag twice

I cannot add one tag multiple times. If i select one tag, that tag not showing again in the list. Is there a way to add a tag twice?

I have same problem, plis any suggest mbenford? thankyou 👍

This issue was selected to be spring-cleaned by a script. More information can be found here.
If anyone thinks this was a mistake and this issue should be reopened, please leave a message below explaining why. Before doing so, please consider reading the CONTRIBUTING file.


Show others category in the permissions page

What is the motivation for adding/enhancing this feature?

Currently permissions which are not in any category are not shown in the permissions.
Hide the permission with hidden category and show all others permissions without category in Others category.
What are the acceptance criteria?

[ ] ...

Can you complete this feature request by yourself?

[ ] YES
[ ] NO

Additional information

Changes verified and working fine in release v1.9.0. Hence, closing this ticket.
https://jam.dev/c/ba4c187c-339f-47eb-a331-8ae74a836179


Fix warning for elasticlunr user configuration parse

Supply an empty object as the user configuration in example script to suppress the following warning:

Thank you for thèse PR's.

I have not my computer for now I'll publish changes to npm as soon as possible.


Remove workaround for "values" being both a Mapping method name and STIX property name

Fixes #324 .
The workaround didn't work (caused crashes under some circumstances).  Now, attributes whose names conflict with Mapping methods will have the Mapping interpretation.  Same-named STIX object properties will not be accessible as attributes.

The table formatting problem seems to have been the fault of pandoc, which is what sphinx uses as its format converter.  It has its own markdown extensions, which unfortunately result in ambiguity: it allows 3+ dashes to indicate a horizontal rule, same as standard markdown, but reuses the same syntax for its tables (several dashes above and below).  Jupyter rendered it just fine, so it must use a different system for converting markdown to HTML.  That is unfortunate; now we have to keep two systems happy.
Anyway, I changed it to the other format, and changed the content to not pick on the Mapping methods, since the problem is more general than that.  I didn't give an exhaustive list, only said that accessing certain attributes which collide with method names will return a bound method.


Create do-not-kick

Removes kick option from clan chat on configurable option

I think it won't break anything, but normally we config groups are lowercase alphanumeric, so @ConfigGroup("donotkick")


[JN-935] i18n address validation

DESCRIPTION
A bunch of the participant address validation code got accidentally deleted on a merge (this was my bad) but we didn't notice because it was the code that enabled address validation on the participant profile, which was disabled until we get production keys.
TO TEST:  (simple manual steps for confirming core behavior -- used for pre-release checks)

Rebuild core
Restart admin api/ participant api
Fill out demo again
Log in as jsalk / create new participant
Go to profile & switch to spanish or DEV
Edit mailing address, observe flows
Enter 123 BAD INVALID_STREET_NAME Rd (or any INVALID_{address component}) to test out different invalid fields
Enter 123 IMPROVABLE St and observe the improvable modal is internationalized
Go to basics form, do the same ^ but with the mailing address form on page 2.

Code looks good, but I get the following trying the improvable address in Spanish for jsalk:  are those message keys expected?

Hmm, this is weird. I tried again just now and it worked OK for me.

I wonder if there was some issue on syncing the language texts maybe?

just retried, and it works.  as Matt said, must have been a reload issue


Concatenated string sequence as primary key - Insertion fail via EF code

Describe what is not working as expected:
I want to use a concatenated string to a sequence as a primary key of a table.
I have created the table using Code-First migration successfully, and have set the default value of the column to be the desired concat.
When I insert rows to the table manually using the INSERT command, it works as expected. If I choose to omit the value of the column, it is generated from the sequence, otherwise - it uses the value provided.
However, when I try to insert entities by code - an exception is being thrown.
The relevant field of the entity is a simple string property. I tried adding [DatabaseGenerated(DatabaseGeneratedOption.Computed)] (also identity, and none) annotation, but that didn't do the trick. When I set the property to Identity (I called directly the ValueGeneratedOnAdd through the fluent api) it just generated a GUID, not taking into consideration the default value provided.
If you are seeing an exception, include the full exceptions details (message and stack trace).
Exception message: `System.InvalidOperationException: 'Unable to create or track an entity of type 'EntityName' because it has a null primary or alternate key value.'`
Stack trace: `at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.NullableKeyIdentityMap`1.Add(InternalEntityEntry entry)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.StartTracking(InternalEntityEntry entry)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.InternalEntityEntry.SetEntityState(EntityState oldState, EntityState newState, Boolean acceptChanges)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.EntityGraphAttacher.PaintAction(EntityEntryGraphNode node)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.EntityEntryGraphIterator.TraverseGraph(EntityEntryGraphNode node, Func`2 handleNode)
   at Microsoft.EntityFrameworkCore.DbContext.SetEntityStates(IEnumerable`1 entities, EntityState entityState)`

I can think of workarounds such as first generating the value manually and only then updating the entity and saving it, or having a column for the sequence generated value, and a trigger update that column, but I'd like to avoid them if possible.
Further technical details
EF Core version: (found in project.json or packages.config) - 1.1.1
Database Provider - Microsoft.EntityFrameworkCore.SqlServer
Operating system: Windows
IDE: Visual Studio 2017
(Also opened on StackOverflow)

@urielb92 You likely need a call to HasDefaultValueSql as explained in #4189. See also #7872.

I have called 'HasDefaultValueSql'. That's how I set the default value, which works on manual insert

@urielb92 Can you post some code that reproduces the issue? A full project or code listing is preferable, but just your entity types and OnModelCreating may be sufficient.

Sure, I'll post the the relevant parts later when I have access to the code

@ajcvickers Sorry for the delay, posting the relevant parts of the code.
This was scaffolded from the DB so the context is a bit verbose, so i'll just post the relevant parts.
Also - I've added the functionality through a migration, since a sequence had to be created.
The entity :
`    public partial class TheEntity
{
public EntityName()
{
}
    [Column("EntityColumnNameInDb")]
    public string Id { get; set; }
    // Some other properties
}`

DbContext :
`
protected override void OnModelCreating(ModelBuilder modelBuilder)
{
// ...
modelBuilder.Entity(entity =>
{
entity.HasKey(e => e.Id)
.HasName("PK_EntityTable");
            entity.Property(e => e.Id).ValueGeneratedNever();

             // ...
           }
           // ...
    }

`
The migration  :
`
protected override void Up(MigrationBuilder migrationBuilder)
{
migrationBuilder.Sql(@"CREATE SEQUENCE EntitySequence START WITH 1 INCREMENT BY 1;");
        migrationBuilder.AlterColumn<string>(
            name: "EntityColumnNameInDb",
            table: "EntityTable",
            defaultValueSql: "'i' + CAST((NEXT VALUE FOR EntitySequence) AS VARCHAR(20))",
            nullable: false,
            oldClrType: typeof(int),
            oldDefaultValueSql: null);
    }

`
I think that's all the relevant parts. Thanks for the help.

@urielb92 This line tells EF that you never need any kind of store-generated value:
entity.Property(e => e.Id).ValueGeneratedNever();

so you need to remove that,
Then, as explained in #4189 and #7872, you need to put this in your OnModelCreating:
entity.Property(b => b.Id)
    .ValueGeneratedOnAdd()
    .HasDefaultValueSql("'i' + CAST((NEXT VALUE FOR EntitySequence) AS VARCHAR(20))");

This tells EF to generate values and that the column has SQL to do this.

Hi, I've tried your suggestion before (described in the main post), and it resulted with the Id being generated as a GUID, totally ignoring the default value. Just to make sure, tried it again - same results.


createSprite task no longer woks and throws an error with mustache

I'am no longer able to create a sprite and receive an error message, making reference to the mustach:
\Users\SCV\Documents\WebDevLesson\mySite\ytabo-project\node_modules\mustache\mustache.js:226
      throw new Error('Unclosed section "' + openSection[1] + '" at ' + scanner.pos);
      ^

The createSprite( ) worked well before a minor modification the template was tried.
{{#shapes}}
	{{#first}}    // Including template tag {{#first}} {{/first}}
		.icon {
			background-image: url('/assets/images/sprites/{{{sprite}}}');
		}
	{{/first}}

	.icon--{{base}} {
		width: {{width.outer}}px;
		height: {{height.outer}}px;
		background-position: {{position.relative.xy}};
	}
{{/shapes}}

Can a kind soul help me understand what is going on. First time using the package.
Thank you for your help.


Editor: default program should be language-specific

The last Python program used in the editor should come back when switching to Python:

The browser cache needs to keep track of the programs for each language that can be chosen at the top right.

The browser cache needs to keep track of the programs for each language

I think this is a different issue altogether. I agree with both. Default program should be stored under language configuration. Separately, the browser should store multiple "programs" at the same time (maybe we can leverage the filesystem for this).
Should we keep track on a per-language basis or per-sublanguage basis?

I think it should be done on a per-language basis: Quite often we switch between sublanguages to get this or that language feature or tool to work. The program should not change in that case.

Ok, I'll work on a proposed design over the next few weeks.


[Feat] Lights/Light command

A command to turn off/on the ship lights.

I think I can accomplish this, will add it to the list.

have this working in my dev version, should be out in next patch

this is out in patch 2.1.0


Fixes for running with https frontend

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Complete fix for https://github.com/criticalstack/quake-kube/issues/17

Have you tested this?

Yep, I've got my patched version running right now.

I couldn't get it to work through a Kubernetes ingress. It seemed to want to connect directly to the IP on port 443. Any ideas? It was sat trying to join a game.

@alexellis The way quakejs works it always needs a port to be specified and previously when the port was only implied, it was presuming port 80.  This fix ends up addressing the other scenario where an implicit port is used with https (which will end up being 443).  With that said, I think your issue sounds like a different one from this, if you didn't mind would you open up a new issue with details and steps to reproduce?  That way either myself and/or someone else can try and figure out what might be going.

@ChrisRx @alexellis you probably need another parameter in for this to work - because the IP address of kube node may be different then ingress node, it's safer to assume we need both hostname/dns that ingress sees, and 443 as a port - probably to be checked/swapped in js code for references back to detected machine IP