Linker error 2019 when using shogun on windows

Hello,
I'm trying to use shogun on windows. I built the library with msvc 2015 64bit. In the following there is the cmake report:
Could NOT find CCache (missing: CCACHE CCACHE_VERSION)
Using system's malloc
Could NOT find GDB (missing: GDB_COMMAND GDB_VERSION)
Could NOT find Doxygen (missing: DOXYGEN_EXECUTABLE) (Required is at least version "1.8.6")
dir='C:/Users/myUser/Downloads/shogun-shogun_6.1.3/shogun-shogun_6.1.3/src'
dir='C:/Users/myUser/Downloads/shogun-shogun_6.1.3/shogun-shogun_6.1.3/build/src'
Could NOT find CxaDemangle (missing: HAVE_CXA_DEMANGLE)
Could NOT find CxaDemangle (missing: HAVE_CXA_DEMANGLE)
Could NOT find Eigen3 (missing: EIGEN_INCLUDE_DIR) (Required is at least version "3.1.2")
Could NOT find OPENCL (missing: OPENCL_LIBRARY OPENCL_INCLUDE_DIR)
Could NOT find ViennaCL (missing: VIENNACL_INCLUDE_DIR VIENNACL_ENCODED_VERSION OpenCL_INCLUDE_DIRS OpenCL_LIBRARIES) (Required is at least version "1.5.0")
Could NOT find PkgConfig (missing: PKG_CONFIG_EXECUTABLE)
Could NOT find TFLogger (missing: TFLogger_DIR)
A library with BLAS API not found. Please specify library location.
LAPACK requires BLAS
Could NOT find GLPK (missing: GLPK_LIBRARY GLPK_INCLUDE_DIR GLPK_PROPER_VERSION_FOUND)
Could NOT find CPLEX (missing: CPLEX_LIBRARY CPLEX_INCLUDE_DIR)
Could NOT find MOSEK (missing: MOSEK_DIR MOSEK_INCLUDE_DIR MOSEK_LIBRARY MOSEK_LIBRARIES)
Could NOT find Protobuf (missing: Protobuf_LIBRARIES Protobuf_INCLUDE_DIR)
Could NOT find JSON (missing: JSON_INCLUDE_DIR JSON_LIBRARY) (Required is at least version "0.11")
Could NOT find LibXml2 (missing: LIBXML2_LIBRARY LIBXML2_INCLUDE_DIR)
Could NOT find CURL (missing: CURL_LIBRARY CURL_INCLUDE_DIR)
Could NOT find ZLIB (missing: ZLIB_LIBRARY ZLIB_INCLUDE_DIR)
Could NOT find BZip2 (missing: BZIP2_LIBRARIES BZIP2_INCLUDE_DIR)
Could NOT find LibLZMA (missing: LIBLZMA_INCLUDE_DIR LIBLZMA_LIBRARY LIBLZMA_HAS_AUTO_DECODER LIBLZMA_HAS_EASY_ENCODER LIBLZMA_HAS_LZMA_PRESET)
Could NOT find SNAPPY (missing: SNAPPY_LIBRARIES SNAPPY_INCLUDE_DIR)
Lzo includes and libraries NOT found.
Could NOT find NLOPT (missing: NLOPT_LIBRARY NLOPT_INCLUDE_DIR)
Could NOT find LPSOLVE (missing: LPSOLVE_LIBRARIES LPSOLVE_INCLUDE_DIR)
Could NOT find ColPack (missing: COLPACK_LIBRARIES COLPACK_LIBRARY_DIR COLPACK_INCLUDE_DIR)
Could NOT find ARPREC (missing: ARPREC_LIBRARIES ARPREC_INCLUDE_DIR)
Linker: Default system linker
Could NOT find Ctags (missing: CTAGS_EXECUTABLE)
Failed to locate sphinx-build executable (missing: SPHINX_EXECUTABLE)
Failed to locate pandoc executable (missing: PANDOC_EXECUTABLE)
===================================================================================================================
Summary of Configuration Variables
The following OPTIONAL packages have been found:

 * OpenMP
 * Threads

-- The following REQUIRED packages have been found:

 * PythonInterp

-- The following OPTIONAL packages have not been found:

 * CCache
 * GDB
 * Doxygen (required version >= 1.8.6)
 * CxaDemangle
 * Eigen3 (required version >= 3.1.2)
 * ViennaCL (required version >= 1.5.0)
 * rxcpp
 * TFLogger (required version >= 0.1.0)
 * BLAS
 * GLPK
 * CPLEX
 * ARPACK
 * Mosek
 * Protobuf
 * JSON (required version >= 0.11)
 * LibXml2
 * CURL
 * ZLIB
 * BZip2
 * LibLZMA
 * SNAPPY
 * LZO
 * NLopt
 * LpSolve
 * ColPack
 * ARPREC
 * Ctags
 * Sphinx
 * Pandoc

===================================================================================================================
Integrations
  OpenCV Integration is OFF 	 enable with -DOpenCV=ON
===================================================================================================================
Interfaces
  Python is OFF 		 enable with -DINTERFACE_PYTHON=ON
  Octave is OFF 		 enable with -DINTERFACE_OCTAVE=ON
  Java is OFF 		 enable with -DINTERFACE_JAVA=ON
  Perl is OFF 		 enable with -DINTERFACE_PERL=ON
  Ruby is OFF 		 enable with -DINTERFACE_RUBY=ON
  C# is OFF 			 enable with -DINTERFACE_CSHARP=ON
  R is OFF 			 enable with -DINTERFACE_R=ON
  Lua is OFF 		 enable with -DINTERFACE_LUA=ON
  Scala is OFF 		 enable with -DINTERFACE_SCALA=ON
===================================================================================================================
To compile shogun type
  make

To install shogun to C:/Users/myUser/Desktop/shogun type
  make install

or to install to a custom directory
  make install DESTDIR=/my/special/path
  (or rerun cmake with -DCMAKE_INSTALL_PREFIX=/my/special/path) to just change the prefix
===================================================================================================================
Configuring done
Generating done

The library build successfully but when I try to build the following example code:
#include <shogun/base/init.h>

using namespace shogun;
int main(int argc, char** argv)
{
    init_shogun_with_defaults();
    exit_shogun();
    return 0;
}

I get the following error:
link /NOLOGO /DYNAMICBASE /NXCOMPAT /INCREMENTAL:NO /SUBSYSTEM:CONSOLE "/MANIFESTDEPENDENCY:type='win32' name='Microsoft.Windows.Common-Controls' version='<IP_ADDRESS>' publicKeyToken='6595b64144ccf1df' language='*' processorArchitecture='*'" /MANIFEST:embed /OUT:..\build_release\shoguntest.exe @C:\Users\myUser\AppData\Local\Temp\shoguntest.exe.14740.610.jom shogun.lib(Time.obj) : error LNK2019: unresolved external symbol __imp_timeGetTime referenced in function "public: __cdecl shogun::CTime::CTime(bool)" (??0CTime@shogun@@QEAA@_N@Z) ..\build_release\shoguntest.exe : fatal error LNK1120: 1 unresolved externals
I don't understand where is the problem.

Nobody can help me?

Sorry! As of now, you will have to check how we build shogun in appveyor and try to replicate that.
Any patches fixing potential problems are more than welcome

Is it possible to get the release and debug version of shogun binaries built with AppVeyor?
For would be enough. I need to start a project using shogun, but I'm stuck at the moment.

Shogun is part of vcpkg
https://github.com/Microsoft/vcpkg/pull/2977#issuecomment-371225760
You could try that and let us know how it went

Hi @fyoda, do you solve your problem? I met a similar problem today. vcpkg#9588
btw, @vigsterkr, Is it normal for libshogun.lib to be so huge?

@lyhyl as you can see there's a pr to try to fix this: https://github.com/vigsterkr/shogun/commit/0f959a60b54227d0d2efca17eec7fc352604a6ba
it certainly solves all the unresolved external symbols but i had a problem of actually running the tests... if you happen to have windows on your desk and happy to help maybe we can finally find a final solution for this

I'm glad you're still working on it @vigsterkr. I'll try to solve it based on your pr. I'm just curious why the project will generate such a huge static link library. Really unfriendly to linker😂.

@lyhyl as you can see there's a pr to try to fix this: vigsterkr@0f959a6
it certainly solves all the unresolved external symbols but i had a problem of actually running the tests... if you happen to have windows on your desk and happy to help maybe we can finally find a final solution for this

I noted that you added CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS.
but according to vcpkg maintainer-guide:
Unless the author of the library is already using it, we should not use this CMake functionality because it interacts poorly with C++ templates and breaks certain compiler features.

would that be a good idea?

@lyhyl as you can see there was an error how the dll was generated.. unfortunately until #4792 is not merged the static library of shogun is huge... :(

i mean i had a branch where i've manually set all the SHOGUN_EXPORT things... but i've dropped that in favour of CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS


SDCICD-1178: remove unknown fields from olm artifacts

CatalogSource does not define affinity or toleration fields in the
spec. Also remove the namespace from the RoleBinding.roleRef
2023-12-18T08:04:00Z	INFO	controllers.ObjectSet	API status error with empty reason string	{"ObjectSet": "/managed-openshift-release-bundle-5f548cb8bb", "err": {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"failed to create typed patch object (openshift-osd-metrics/osd-metrics-exporter-registry; operators.coreos.com/v1alpha1, Kind=CatalogSource): .spec.tolerations: field not declared in schema","code":500}}
2023-12-18T08:04:00Z	INFO	controllers.ObjectSet	API status error with empty reason string	{"ObjectSet": "/managed-openshift-release-bundle-5f548cb8bb", "err": {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"failed to create typed patch object (openshift-config/osd-metrics-exporter-watch-configmaps; rbac.authorization.k8s.io/v1, Kind=RoleBinding): .roleRef.namespace: field not declared in schema","code":500}}

https://docs.openshift.com/container-platform/4.14/rest_api/operatorhub_apis/catalogsource-operators-coreos-com-v1alpha1.html
https://issues.redhat.com/browse/SDCICD-1178
Signed-off-by: Brady Pratt<EMAIL_ADDRESS>

/lgtm

/approve


[BEAM-4244] Add an option to ignore decoding excptions.

This can happen if a user supplies data that can be successfully encoded with
a Coder, but the resulting bytes cannot be decoded.  In particular, this can be
caused when encoing TableRows that contain objects with incorrectly implement
jackson method hooks.

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Choose reviewer(s) and mention them in a comment (R: @username).
[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

We typically have asked customers to build the dataflow worker jar or supplied them with one to run and fix up stuck records due to shuffle. The customer would use the --dataflowWorkerJar flag.


Other linux distributions supported than Ubuntu?

Hey there,
i am running a CentOS 7 server and would like to know if its possible to setup Kitematic here.
thanks in advance!

@lddd We don't have a package for CentOS at the moment, but feel free to create a PR for it.
Even though the package doesn't exist, if you have node installed, you can build from source.

Ok thanks for letting me know. I am not familiar with node but i will look at it.

Make sure you have node installed, checkout the repo and type make run

Thanks i will look at it tomorrow, will let you know.


Release 0.10.1

@arshaw Once this merged I'll publish a release.

https://www.npmjs.com/package/@js-temporal/temporal-test262-runner
Published.
I'll try and fix #17 this week.
Going forward, it would be nice to have a GH Action check that we update the CHANGELOG alongside any changes...


Fixed ping bot examples

Previous example had no EventHandler argument passed to Client::new.

Will do. Made this in a couple minutes so forgot about imports.


SVG canvas

Hi, is there a way to record when the canvas is declared with a SVG renderer: ' createCanvas(400, 400, SVG); ' ?
I'm running a SVG animation that's imported in the canvas with loadSVG() but when trying to record it I get an error. If I load the SVG with loadImage() in a normal canvas ' createCanvas(400, 400); ' the recorder works but the SVG is still (no animation).

Hi, @EltonoLab. Thank you for reporting this one!
I don't think there is an SVG renderer in p5.js, are you using a library such as p5.js-svg?
I have no plans to support an SVG renderer at the moment.

Hi, yes, we're loading p5.svg.js. I guess I'll have to record the animations one by one with a screen capture. Thank you anyway!


[Question] Entities used in the Web project

I have a quick question:
Is it OK if we are using Entities from the core layer of the clean architecture into the Web project (the presentation layer)?
I saw HERE that we have a dependency to the Entities from the core layer. Doesn't this brakes the principle of the Clean Architecture that we do not have to depend on the core dependencies?
Thanks in advance!
P.S. Any explanation with more details will be appreciated.

You are right, it's not right. This template defines three different approaches to building UI (MVC, Pages, and SPA). In SPA you can split projects but in MVC and Pages, you cannot.
In my opinion, we can define the project for contracts - shareable models between UI, API, and Core. We can use T4 templates or the heaviest approach - NSWAG to create clients for SPA.
I'm using contracts for API and T4 for SPA. It compromises between duplication and a "clean" approach.

I'm trying to figure out the best approach for a MVC project.
@Xeinaemm what do you mean by "define the project for contracts - sharable models"?
Is it that we can extract the models as a separate project referenced by every level of the Clean Architecture or something else? And if yes - what is the right way to map them with the Domain entities (in which layer or which approach to use)

Contracts? In most cases, something that you want to share without duplication(read models), API endpoints(generated by Refit in my case)m commands' models and service broker messages.
I'm splitting API into ReadAPI with Contracts.API(general purpose) that allows you to create only data with predefined models that you want to share internally and externally(for example different domains want data that you normally share because it's your domain - for example you can use Github API. I'm going further and predefining API calls with Refit and models for that).
On the other hand, PresentationAPI with Contracts.PresentationAPI handles internal read/write(CQRS). In this case, it's something that you don't want to share externally but use in UI like read models for views and commands models for actions. In SPA you can use this to generate APIs and models for JS or TS.
Read models are simple - read what you want from DB without knowing how the domain is created.
In write mode, you need to create commands that handle changes of domain models and models change themselfs or propagate domain events further.
I want to mention that this approach is for monolith that going into microservices(60+ internal systems and more than 150 services), in most cases simple CQRS that just split read models from write models will be enough.
My colleague created very good DDD example: here

You're correct; it would ideally use a DTO for the items returned. I'll make a note to fix it or if someone wants to add a simple pull request with a fix I'd consider it.

Resolved in the linked PR.


Save player head prices as integers if set

Missed this in testing - if a custom price is set, it bugs to $0 out if there's a string that's not "default"

Another really big, fat reminder that I need vault on my server.


x86 node bundled with macOS arm64 package

Agent Version and Platform

v3.214.0
macOS 13.1 (22C65)
Mac Studio with M1 Max (arm64)

Azure DevOps Type and Version
on-premises, 2020 Update 1.1
What's not working?
We are experiencing following error when running Kotlin Multiplatform Mobile tests for iOS devices:
> Task :shared-br-common:iosSimulatorArm64Test FAILED
An error was encountered processing the command (domain=NSPOSIXErrorDomain, code=86):
Process spawn via posix_spawn() failed.
Bad CPU type in executable
Underlying error (domain=NSPOSIXErrorDomain, code=86):
	The operation couldn’t be completed. Bad CPU type in executable
	Bad CPU type in executable

After some debugging we traced the issue to the node binary files being bundled to be x86_64 instead of arm64:

externals/node/bin/node is x86_64
externals/node10/bin/node is x86_64
externals/node16/bin/node is arm64

Copying the binary from node16 to the node and node10 folders solves the issue.
As the release is described as macOS arm64 the bundled binaries should also be for this architecture.

Hi @crysxd thanks for reporting! We are working on more prioritized issues at the moment, but will get back to this one soon.

Hi @crysxd
In case you are using at least one task which targets Node10 or Node6, you will need to have Rosseta2 installed on a mac machine since NodeJS is not providing Node10/6 binaries for arm64 on mac.
Also, you can try to set the environment variable AGENT_USE_NODE=16, which will force the agent to use node16 for all tasks, but it might break some of the tasks due to incompatibility with node16.
We are migrating existing tasks to node16, but if you are using marketplace task you probably may reach task owners to ask for migration for a specific task.
Please let me know if you have any additional questions.

Thanks @kirill-ivlev! That's really helpful information. I guess our solution kinda does the same as we overwrote the node and node10 binaries with node16. Most of what we do is shell script based tasks, so the actual node version shouldn't matter too much in our case.

Closing due to inactivity.


Improve error messages and warnings

In each of our steps (fit_dataframe, export, from_json, synthesize) it would be nice to think a bit more about friendly and helpful error messages. Especially in the first one, it's very important to attend users to the different options. Also, we used to have this warning for unique values which is now gone?
I feel like this is an area where we can look at the tidyverse once again. Let's think about what can go wrong for the user in each of these steps and come up with nice error messages!

I would love to taka a look at this!

I had hoped so 😄 we can use this issue to communicate about this and make some kind of checklist. Maybe it's a good idea to first create some kind of inventory of things that can go wrong / are likely to go wrong before we start writing code. Kind of like what happened here: https://github.com/sodascience/metasyn/issues/228

Yep sounds good, I'll get started on it today and throughout the week.

Work in progress list of what can go wrong:
Fitting a metaframe:

[ ] Trying to fit to an incompatible input (trying to fit to something that is not a DataFrame)
[ ] Errors in meta_config
[ ] Errors in var_spec

Exporting/Importing a metaframe to file:

[ ]

Generating synthetic data from the metaframe:

[ ]

For some extra context, here is an example of what I would consider an excellent error message from the R package dplyr:

Can I get ahead and start writing code? Or would you like to discuss this PR and the check-list on Monday beforehand? @vankesteren

@Samuwhale This PR will conflict with the other PR #275, so there might be some extra work involved if you do it right now.


collections: Add examples for each function

Continues work started in #3673 within a ponylang owned branch.
Only ~1/2 done with the docstrings so not ready to merge, but has been rebased on main and work by palash25 has been preserved.

Perhaps someone on Sync tomorrow can explain to me why reserve() and the len of create(...) are not being used. I avoided mention of this in the docstrings, but as it is now there does not appear to be any "reserve space for additional elements" functionality, rather space is added as needed.

@rhagenson I think the comment you are removing is important. Those methods exist because it is needed to implement the Seq interface. They don't make sense for a List but they exist so that List can be swapped in for other sequable collections.
I think you should leave the existing comment. You can add to it like you did with create but reserve should rename unchanged.

In general I think your comments that I read were good as long as those two methods mention that they exist in part to fulfill the seq interface.

@rhagenson no, but i can tell you that @kulibali and i have been trying to figure out why we are seeing really odd behavior from the tcp unit tests in CI. you can probably ignore those those failures if they windows + tcp and you haven't touched any code near those.

@rhagenson this has been sitting around for a while, even if not done, do you want to give this a little polish and then we can merge whatever there is even if it doesn't close the issue in question?

@SeanTAllen It is ready for review and merge. If you review it and more polish is needed I will get the necessary work done before merging.


error with entry.sh

Hi, i hope someone can help me, i'm trying to run the docker with the command given and modified the command as told to and i'm getting:  /entry.sh: /entry.sh: is a directory.
this is the command i used: sudo docker run -t --net=host --env="DISPLAY"
--volume="$HOME/.Xauthority:/root/.Xauthority:rw"
-v  /home/leo/Downloads/software/EagleEye/known
-v  /home/leo/Downloads/software/EagleEye/result
-v /home/leo/Downloads/software/EagleEye/Repository/entry.sh:/entry.sh
eagle-eye
thanks in advance for the help!

Check your path. Also try using bare-metal.

Check your path. Also try using bare-metal.

Hey man, I'm stuck at the same issue. I tried everything, also gave 777 permission etc.
Do you perhaps have a clue? The current working dir is just the EagleEye folder. And
the entry.sh file was there when I downloaded the project, so should be good to go right?
Thanks!

Check your path. Also try using bare-metal.

Hey man, I'm stuck at the same issue. I tried everything, also gave 777 permission etc.
Do you perhaps have a clue? The current working dir is just the EagleEye folder. And
the entry.sh file was there when I downloaded the project, so should be good to go right?
Thanks!

Try using the full path for the entry file and not a relative path. This seems to be a common docker issue (not really related to this project)

Try using the full path for the entry file and not a relative path. This seems to be a common docker issue (not really related to this project)

Try using the full path for the entry file and not a relative path. This seems to be a common docker issue (not really related to this project)

Hey man, yea I tried that too of course, in many forms. so "/home/etc/etc/EagleEye/entry.sh" or ./ or ~/ all of it.
Is it maybe because there is an error generated, but that is shown as "entry.sh is a directory?"
Because when I run "sudo python3 eagle-eye.py -h" then it shows a whole different error "No module named 'requests_html'" which means it maybe go further than the first rule?

Try using the full path for the entry file and not a relative path. This seems to be a common docker issue (not really related to this project)

Hey man, yea I tried that too of course, in many forms. so "/home/etc/etc/EagleEye/entry.sh" or ./ or ~/ all of it.
Is it maybe because there is an error generated, but that is shown as "entry.sh is a directory?"
Because when I run "sudo python3 eagle-eye.py -h" then it shows a whole different error "No module named 'requests_html'" which means it maybe go further than the first rule?

I found out that when you change /entry.sh on the bottom of the dockerfile and change it with ./entry.sh it will go on.
It looks like the error is coming from the bash command out of docker. So indeed nothing to do with eagle-eye.
Now I get other errors, but I will try to continue on.

I found out that when you change /entry.sh on the bottom of the dockerfile and change it with ./entry.sh it will go on.
It looks like the error is coming from the bash command out of docker. So indeed nothing to do with eagle-eye.
Now I get other errors, but I will try to continue on.


Add parsing of param dependencies

Describe what this PR does and why we need it:
Ready for review
Change to parse the dependencies defined by apb.yml and map them to valid json schemas
Does this PR depend on another PR (Use this to track when PRs should be merged)
depends-on https://github.com/automationbroker/bundle-lib/pull/70
Which issue this PR fixes (This will close that issue when PR gets merged)
fixes #859

@jmrodri example of this working with the catalog pr linked above
https://youtu.be/MX-G0TjaP7E

Please see my comments  in bundle-lib#70 about documentation updates and incrementing of the bundle spec to 1.1. I would also encourage some changes to this PR that would do a check on the version or at least be backwards compatible so that the version is more just a representation of the spec than actually changing code paths.

cc @maleck13 Still work to be done here but be nice to get some early feedback.

Coverage increased (+2.3%) to 38.864% when pulling 0a290d744c593e32402061c34a5f61a0dbc4d8a6 on PhilipGough:conditionals into d05629f6559221f2db5feb45c5d2c648e534ccf8 on openshift:master.

@shawn-hurley I've update the bundle-lib dependency as part of this PR FYI


Update to the latest YCM version + some improvements

Update YCM files to latest version (0.8.1)
Use EXPORT instead of TARGETS_PROPERTY in install_basic_package_files
Require CMake 3.5
Build position independent code and disable compiler extensions
Add optional dependency on YCM

To be honest, I am not a big fan of the optional dependency on YCM. The relation with YCM and the reason why those files are vendored is clearly explained in the README, and adding the optional dependency on YCM would just make it more difficult to debug the CMake build  script in case some strange version of YCM is installed in the system, without removing the problem that the internal files are  vendored and so they need to manually updated.

@traversaro would a comment instead be ok for you?
# If you don't want to ship these files with your code (recommended), you can
# instead depend on YCM.
# In this case replace the following line with
# find_package(YCM 0.8.1 QUIET)
list(APPEND CMAKE_MODULE_PATH ${CMAKE_CURRENT_SOURCE_DIR}/cmake)

Replaced optional dependency on YCM with a comment.
I also added a new commit, fixing the RPATH support (INSTALL_NAME_DIR should point to the libraries are installed, i.e. CMAKE_INSTALL_FULL_LIBDIR, not to CMAKE_INSTALL_PREFIX), and removing the ENABLE_RPATH option in favour of CMake standard options (fixes #7).

Please also note that @mbrunettini is doing some tests with Genkins on master branch, so please do not merge this until he finishes.
Please @mbrunettini let us know when you are ok with the test so that we can clean master commits and merge this PR!
Thanks everyone for the collaboration 🎉

Updated with the comments requested (I added an extra comment on the PIC one about shared libraries linking non-PIC static ones) and added links to YCM modules documentation

Please don't merge until @mbrunettini has finished with Jenkins tests.

@drdanz can you please rebase on master and remove the commits related to the Jenkins files? After that I merge the PR. Thanks!

@claudiofantacci done.

Thanks @drdanz!


fix: prevent action replay

Fix #27
Prevent action replay

This check only if the given id already exists in the messages table
Validate that hash is valid if passed in the body

We should not rely on the signature to detect duplicate but the message id instead, there is multiple message with same sig, Safe always sign with "0x" as signature for example.

We should not rely on the signature to detect duplicate but the message id instead, there is multiple message with same sig, Safe always sign with "0x" as signature for example.

fixed

Don't merge until https://github.com/snapshot-labs/snapshot-sequencer/pull/172/ else users may face an issue

What kind of issue?

IGNORE have been removed from the insert message query. This query should never fail, since we're now manually checking for duplicate


Support multiple sqlite configurations

We should be able to support the following configuration:

Using system sqlite
Using a custom sqlite provided by us
Using sqlcipher

Performance Results comparing between the current storage engine and the new storage engine with a new ported SQLiteDatabase wrapper. The test used Android System SQLite library and ran on Nexus 4 with Android 5.5.1. Time was measured in Milliseconds.
Test1_CreateDocs

num docs
doc size
current
new

100
1K
282
260

100
100K
1551
1534

Test2_CreateDocsUnoptimizedWay

num docs
doc size
current
new

100
1K
2810
1726

Test3_ReadDocs

num docs
doc size
current
new

100
1K
169
163

100
100K
606
556

Test4_CreateAttachments

num docs
doc size
current
new

1
5M
406
359

Test5_ReadAttachments

num docs
doc size
current
new

1
5M
107
107

Test6_PushReplication

num docs
doc size
current
new

100
1K
2197

Test7_PullReplication

num docs
doc size
current
new

100
1K
2086

Test8_DocRevisions

num docs
num updates
current
new

100
10
19645
19623

Test9_LoadDB

num docs
doc size
current
new

100
1K
55
29

Test10_DeleteDB

num docs
doc size
current
new

100
1K
4
2

Test11_DeleteDocs

num docs
doc size
current
new

100
1K
509
449

Test12_IndexView

num docs
current
new

100
129
111

10K
8468
7437

Test13_QueryView

num docs
current
new

100
15
12

10K
917
792

Test14_ReduceView

num docs
current
new

100
21
14

Test15_AllDocsQuery

num docs
doc size
current
new

100
1K
11
10


[Feature Request] add SMAC envs

🚀 Feature
add SMAC envs
paper link：The StarCraft Multi-Agent Challenge
Motivation
No response
Additional context
No response
Checklist

[X] I have checked that there is no similar issues in the repo
[X] I have read the documentation

add in #109


2024.5.0b0 - HomeAssistantType is a deprecated alias

Version of home_assistant
2024.5.0b0
Version of the custom_component
v2.1.2
Describe the bug
The following error message appears in the log since the latest beta version.
Debug log

2024-04-26 18:55:55.873 WARNING (ImportExecutor_0) [homeassistant.helpers.typing] HomeAssistantType was used from dwd_weather, this is a deprecated alias which will be removed in HA Core 2025.5. Use homeassistant.core.HomeAssistant instead, please report it to the author of the 'dwd_weather' custom integration
2024-04-26 18:55:55.876 WARNING (ImportExecutor_0) [homeassistant.helpers.typing] HomeAssistantType was used from dwd_weather, this is a deprecated alias which will be removed in HA Core 2025.5. Use homeassistant.core.HomeAssistant instead, please report it to the author of the 'dwd_weather' custom integration

Thanks for reporting. I'll fix this.


Getting stats pre-vacuum

Codecov Report

Merging #35 (dd1b7d7) into main (3b494fa) will increase coverage by 0.05%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main      #35      +/-   ##
==========================================
+ Coverage   98.51%   98.56%   +0.05%
==========================================
  Files           8        8
  Lines         743      769      +26
  Branches       72       74       +2
==========================================
+ Hits          732      758      +26
  Misses          3        3
  Partials        8        8

Flag
Coverage Δ

unittests
98.56% <100.00%> (+0.05%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

hydro/_delta.py
97.50% <100.00%> (+0.67%)
:arrow_up:

hydro/delta.py
97.95% <100.00%> (+0.06%)
:arrow_up:

tests/delta_test.py
100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


UI: Remove "Help explain button" in Manage rule view

Describe the bug
view screenshot

@leiyre We need to create another issue to cover the info modal


docs: add Robin's CR 2024 talk link

Please verify the following:

[ ] yarn test jest tests pass with new tests, if relevant
[ ] yarn lint eslint checks pass with new code, if relevant
[ ] yarn format:check prettier checks pass with new code, if relevant
[x] README.md (or relevant documentation) has been updated with your changes

Describe your PR

Updates the docs with Robin's CR 2024 talk link to the YouTube recording

Feedback - can you make this 4 thumbnails -  It's easy to scroll past it as text.

Takes longer to do that, but probably would add 10x on clicks

I like it.  I would approve as is-  @jamonholmgren @robinheinze ?
We can always improve later

:tada: This PR is included in version 9.8.2 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Support keeping a sample of failed row ids for data validators

Description
When running the data validation as part of profiling, we should support user specifying a row id and then we can keep a buffer of the row ids of any failed row.

[x] I have reviewed the Guidelines for Contributing and the Code of Conduct.

fixed by https://github.com/whylabs/whylogs/pull/1147


The images pasted from the clipboard do not appear.

image  pasted from the clipboard is useful feature，does intend to support this feature？

This would definitely be a helpful feature, will look into supporting it in the next releases (might need to add additional configuration options on where to save these images)


chore: Add is_zero check in g1_lincomb [DO NOT MERGE]

This checks whether the scalar is zero and skips the multiply and add operation.

Opening it here to check performance diff on CI -- on my laptop it was negligible.

Closing as this did not produce any significant performance diff


Still having trouble uploading lineups from exported csv to FanDuel

Was the FanDuel ID format changed in the CSVLineupExporter in 2.7.0?
Still can't upload the lineups generated using 2.7. Gives an Invalid entry error.
I'm thinking its because the ID is no longer Name(ID) but it is now ID:Name. Any thoughts here?

how does your export look?


Component: Lightbox Media Viewer - Allow title & description to be customized when using video

The problem
The current component loads the title and description directly from media center via the API. As an adopter of the library we would like the ability to tailor these content sections to our users, rather than the default title and description provided.
The solution
Allow the user to pass props in to override the title and description provided by the API.

@rsebade would you be interested in making this change and contributing it back?

Roberta will schedule a meeting to talk to Ryan about contribution model.  Ryan, Jeff invitees.

Meeting scheduled Monday, Sep 28.

Ryan has volunteered to make these changes.  Assigned the issue to him.  He will work on it in sprint 20-20.

@rsebade I am moving this to the next sprint.  Have you worked on this feature request?  We link the PR's to the issues so that we know when dev has finished their work.

Hey @RobertaJHahn , sorry about the delay, I just submitted a pull request!


Bug: Accessing protected members from a static function in a derived class is declined.

TypeScript Version:  2.0.3
class C1 {
	protected foo() {};
	static generateFor(x:C1) {
		const RetVal = new C1();
		RetVal.foo(); //Compiler allows access of protected member from static method in the class itself
		return RetVal;
	}
}

class C2 extends C1 {
	static generateFor(x:C2) {
		const RetVal = new C1();
		RetVal.foo(); //Compiler disallows access of protected member from static method in child class
		//error TS2446: Property 'foo' is protected and only accessible through an instance of class 'C2'.
		return RetVal;
	}
}

Expected behavior: A static function in a class extending a class C can access all protected and public, but not private members of instances of C
Actual behavior: Protected members are not accessible,Compiler throws TS2446
For reference the simple case without inheritance, which works as expected:

A static function in a class C can access all private,protected and public members of instances of C (works as expected)

Why would a static method be allowed to do something an instance method can't? See also #11278, #10637, #8512

Why would a static method be allowed to do something an instance method can't? See also #11278, #10637, #8512
Instance methods can access protected members of the base class. That's the purpose of protected.

Please see the linked issues.

Okay, I see the point in #8512. I will discuss on there.

Just thinking out loud here but if ECMAScript ever introduces nested, instance member classes, we could end up with something interesting like Scala's path-dependent types.

Actually I suppose we already have that with class expressions. As much as I think classes are over used there is something really interesting about combining classes and closures...


Allow to download pipline metadata via UI to replay with cli

I would be nice if I could download the metadata object via the UI as something like json to then use it to locally test with it (maybe adjusting some parts of it) via cli exec.

pipeline/frontend/metadata.go create the info from a pipeline (stored in db etc...)  and pipeline/frontend/metadata/* contains al types and is ready to be de-/serialized


Change log prints only to Debug mode

Hi @sijms ,
After the resolution of the issue #23 , there is 3 lines that is always printing logs.
Lines that is generating the prints:
// all data returned from the server
fmt.Println("data returned: ", data)

// redirect address
fmt.Println("redirect address: ", pck.redirectAddr)

// reconnect data
fmt.Println("reconnect data: ", pck.reconnectData)

Is it possible to change the code to print these 3 lines only when running in Debug mode?

I make changes


Adding UI configuration

It would be useful to add in the ability for setting some UI configuration. One use case is that my team uses hound to search our private repos, but we almost universally want to do case insensitive searches. It would be great if we could just drop in a config file for the UI as well as the main service to control this.
A possibility for this would be support dropping in a config.js file into ui/assets/js, and in the server just check if that file exists and render it inside of some script tags just like the main hound.js. For our specific use case we would also need to add in a check for a defaultIcase and use that here.
If a simple approach like this seems agreeable, then I could put together a quick attempt.
Thank you

Hi, if you have interest and time, please do submit a Pull Request.  Cheers!

Seconded, and it could be cool to see a list of things that would be turned into features.
One thought is that it could be interesting to include it as a key in the same config, to reduce the need to manage two separate files. Another thought is that we could use a Webpack loader to provide access to the config's values at build time, instead of adding an additional script tag to the page.


Logger isn't finalized upon test/predict completion

🐛 Bug
Some loggers (like TensorBoardLogger) require flushing/finalize to be called for logged metrics to be properly written to disk. However, finalize is not currently called after test/predict runs.
This manifests in metrics failing to be logged if .test or .predict is run on Trainer with a TensorBoardLogger.
I believe this could be fixed with an extra .finalize call (like what is already in https://github.com/PyTorchLightning/pytorch-lightning/blob/master/pytorch_lightning/loops/fit_loop.py#L265-L266) in EvaluationLoop and PredictionLoop. I'm not entirely sure if adding this would cause any issues though, so I'm a bit hesitant to submit a PR myself.
To Reproduce
https://colab.research.google.com/drive/14j7qCoy33y4giqjA8xNfNMCK81F_OvFH?usp=sharing
Expected behavior
Metrics should be logged, regardless of whether .fit, .test, or .predict is called.
Environment

CUDA:

GPU:
available:         False
version:           10.2

Packages:

numpy:             1.19.5
pyTorch_debug:     False
pyTorch_version:   1.9.0+cu102
pytorch-lightning: 1.4.0dev
tqdm:              4.41.1

System:

OS:                Linux
architecture:x

64bit

processor:         x86_64
python:            3.7.10
version:           # 1 SMP Sat Jun 5 09:50:34 PDT 2021

@ananthsub

@awaelchli this is what https://github.com/PyTorchLightning/pytorch-lightning/pull/8217 was attempting to solve


JS character escapes in the result

Using version 1.0.41, I get escaped newline chars in the output...
css = lessEngine.compile(MyClass.class.getResource("/test.less"));
// FIXME: Why is the returned string JS-escaped?!?
css = css.replace("\\n", "\n");

Also, the example in README.md is misleading. The returned value is the compiled CSS text, NOT a url...
// Compiles an URL resource
String css = engine.compile(getClass().getClassLoader().getResource("META-INF/test.less"));

Can you please provide a simple test that reproduces the problem. It seems that the provided tests don't have such a problem.

I'd like to reproduce this, but just getting there is extremely painful. There is some serious work needed on the error handling and reporting, as can be seen again in the following command trace:
#> cat test.less
.test {
    width: 10px;
}

#> mvn clean package
...

#> java -jar target/lesscss-engine-1.1.4-jar-with-dependencies.jar test.less Oct 22, 2011 4:56:14 PM com.asual.lesscss.LessEngine <init>
WARNING: Using implementation version: Rhino 1.6 release 7 2007 08 19
Exception in thread "main" com.asual.lesscss.LessException: Parse Error: Syntax Error on line 1 (line 1, column 9) near
test.less
	at com.asual.lesscss.LessEngine.parseLessException(LessEngine.java:184)
	at com.asual.lesscss.LessEngine.compile(LessEngine.java:82)
	at com.asual.lesscss.LessEngine.main(LessEngine.java:196)

#> java -version
java version "1.6.0_26"
Java(TM) SE Runtime Environment (build 1.6.0_26-b03-383-11A511)
Java HotSpot(TM) 64-Bit Server VM (build 20.1-b02-383, mixed mode)
´´´

This is using a downloaded copy of the GitHub repo from just now on my Mac... :-(

I just pushed a fix that will make the above sample work as expected. So far the lack of a second output argument was causing the "test.less" to be interpreted as a LESS string instead of a File reference.

Tnx, easier to run now. Also good would be to be able to do this:
#> java -jar target/lesscss-engine-1.1.4-jar-with-dependencies.jar - < test.less > output.css

And the above would actually probably reproduce the actual problem. Because I finally realized that we weren't using LessEngine.compile(URL), but instead the LessEngine.compile(String) method... Which is hardly tested (and not with newlines) in the test code you linked earlier.


Remove leader election since it is not used

Leader election isn't used in Eraser, so it shouldn't be an option in the configmap.
Environment:

Eraser version: v1.0.1-beta.1
Kubernetes version: (use kubectl version):

Unfortunately, the field is part of the ControllerManagerConfigurationSpec which is a member of the EraserConfig struct. I'm not sure if it can be easily removed.
However, I think we can remove it from the helm chart.

related https://github.com/kubernetes-sigs/controller-runtime/blob/f83169592e24f80c1704b4c5bf5022620313a271/pkg/config/config.go#L33


TextVectorization layer error with 3D input data

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): no
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Colab
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device: no
TensorFlow installed from (source or binary): Colab 2.x
TensorFlow version (use command below): v2.2.0-0-g2b96f3662b 2.2.0
Python version: Colab default
Bazel version (if compiling from source): no
GCC/Compiler version (if compiling from source): no
CUDA/cuDNN version: no
GPU model and memory: no

Describe the current behavior
TextVectorization layer limits input shape to 2D tensors.
Describe the expected behavior
TextVectorization layer should work well with tensors of any shape, e.g.:
1D - skipgram word2vec input ([batch of words])
2D - default [batch; words] input for many nlp tasks (currently works)
3D - fasttext skipgram input ([batch; words; character ngrams]
Standalone code to reproduce the issue
https://colab.research.google.com/drive/122NTBK6Gr2V2cHSVyXG5xqANh_N-oeNo?usp=sharing
Other info / logs Include any logs or source code that would be helpful to
diagnose the problem. If including tracebacks, please include the full
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-9-fdd620ffcaa5> in <module>()
      1 # Fails with 1D data
----> 2 vectorization(tf.ragged.constant(data1))

2 frames
/usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/ops.py in set_shape(self, shape)
   1105       raise ValueError(
   1106           "Tensor's shape %s is not compatible with supplied shape %s" %
-> 1107           (self.shape, shape))
   1108
   1109   # Methods not supported / implemented for Eager Tensors.

ValueError: Tensor's shape (11,) is not compatible with supplied shape (None, None)

Both 1D and 3D data fail with TF v2.2.
With TF-nightly 1D data works fine, facing issues with 3D data. Please find the attached gist. Thanks!

I would like to work on this issue

Are you trying to do anything other than a straight index lookup with the TextVectorization layer?

No, i don't. Just INT lookup for any-shaped input requred.

Hi @shkarupa-alex, this should be fixed in the nightly. Also, you might be interested in the StringLookup layer (also exported in nightly) which will do string->integer mapping directly without normalization or other overhead and should work on input of any dimensionality. Try it out and let me know what you think!


Clean the depedencies in package.json

extend and lodash are never used
"dependencies": {
    "extend": "^3.0.0",
    "lodash": "^4.3.0",
    ...
}

Thanks, I removed the unused libraries in the latest commit. I'll update the npm package soon.


Logging in with hosted login page and auth0.js 8

This is less of an issue, and more of a question. I'm using the latest wp-auth0 plugin, and getting users to log in via the hosted login page. It's a custom one using auth0.js 8, though actually I also have the same problem if I turn that off and use the default.
Login works, and users are sent to http://mydomain.com/index.php?auth0=1&code=abc123. When they arrive at wordpress, the code is exchanged OK, but then while the response has an access_token in it, there is no id_token. This causes the JWT parsing to fail as  I mentioned in #305.
I have tried asking response_type=token instead of code, but wp-auth0 seems to require a code - I get missing parameter code if I do that.
I'm sure I've missed something, but I'm not sure what. Does wp-auth0 have specific requirements about the OAuth scopes, audiences, etc that it needs before login?
Side note: I have a passwordless connection that works perfectly, but for the life of me I can't workout the difference. Any help would be lovely :)

OK, fair enough :)

@Floppy - If it helps at all, I've got a branch that uses the hosted login page to process SSO logins which you can use as a bit of a guide. Here is where the authorize link is being built:
https://github.com/auth0/wp-auth0/blob/fixed-sso-login-failing/lib/WP_Auth0_LoginManager.php#L91
... and here is where we request the token:
https://github.com/auth0/wp-auth0/blob/fixed-sso-login-failing/lib/WP_Auth0_LoginManager.php#L216
That last one comes back with an access_token and id_token. Some of that flow is going to change a bit as you don't actually need the id_token, you can request user info from /userinfo:
https://auth0.com/docs/api/authentication#get-user-info
... but might be a helpful example. WIP, by the way, not ready for production quite yet!

I come to this forum nightly looking for potential answers to the last month of nightmarish debugging trying to get from the functional days of Delegation and WP Rest API. I can't wait to go try this. Thank you!


Syslog ng bump

:tada: This PR is included in version 1.58.0-develop.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Data race in CI IRC

==================
WARNING: DATA RACE
Read by goroutine 39:
  github.com/flynn/flynn/Godeps/_workspace/src/github.com/thoj/go-ircevent.(*Connection).pingLoop()
      /opt/flynn-test/src/github.com/flynn/flynn/Godeps/_workspace/src/github.com/thoj/go-ircevent/irc.go:156 +0x1a1

Previous write by goroutine 37:
  github.com/flynn/flynn/Godeps/_workspace/src/github.com/thoj/go-ircevent.(*Connection).readLoop()
      /opt/flynn-test/src/github.com/flynn/flynn/Godeps/_workspace/src/github.com/thoj/go-ircevent/irc.go:76 +0x618

Goroutine 39 (running) created at:
  github.com/flynn/flynn/Godeps/_workspace/src/github.com/thoj/go-ircevent.(*Connection).Connect()
      /opt/flynn-test/src/github.com/flynn/flynn/Godeps/_workspace/src/github.com/thoj/go-ircevent/irc.go:379 +0x1223
  main.(*Runner).connectIRC()
      /opt/flynn-test/src/github.com/flynn/flynn/test/runner/runner.go:212 +0x43c

Goroutine 37 (running) created at:
  github.com/flynn/flynn/Godeps/_workspace/src/github.com/thoj/go-ircevent.(*Connection).Connect()
      /opt/flynn-test/src/github.com/flynn/flynn/Godeps/_workspace/src/github.com/thoj/go-ircevent/irc.go:377 +0x11e9
  main.(*Runner).connectIRC()
      /opt/flynn-test/src/github.com/flynn/flynn/test/runner/runner.go:212 +0x43c
==================

Occurred again: https://gist.github.com/josephglanville/42d7323b8e66585b6f87

Flynn is unmaintained and our infrastructure will shut down on June 1, 2021. See the README for details.


ListValidator: Option to discard invalid data

This could be either an option for the existing ListValidator or a new special validator (name?).
Implement a way to validate lists, but instead of raising ValidationErrors on invalid list items, ignore the invalid items.
If the ListValidator has a specified min_length, this should take into account only the valid entries, so with min_length=2, a list with 1 valid and 1 invalid item should NOT be accepted.
For max_length, this could be handled differently. In my opinion it would be okay and maybe better to validate the max_length constraint BEFORE item validation, i.e. with max_length=10, a list with 11 items should be rejected, even when there are invalid items.
Example:
validator = ListValidator(IntegerValidator(max_value=10), discard_invalid=True)
validator.validate([1, 2, "foo", 10, 11, "bar"])
# returns: [1, 2, 10]

# with min_length:
validator = ListValidator(IntegerValidator(), min_length=2, discard_invalid=True)
validator.validate([1, 2, "foo"])    # returns [1, 2]
validate.validate([1, "foo", bar"])  # raises ListLengthError because [1] would be the result, which is too short

Implemented by @lahdjirayhan in #43.
(Release of 0.5.0 at some point next week.)


Implement property-decorators configuration option for pydocstyle

Implements the second part of #2205.
(I did not run pre-commit locally as it's installing the environment indefinitely)

(I did not run pre-commit locally as it's installing the environment indefinitely)

That's fine, only passing CI is strictly required.

Thank you for reviewing and merging! :)


[WIP] Move ExtManagementSystem#vm_log_user_event method to VmOrTemplate#log_user_event

Dependent PRs:

[ ] VMware

Cross-repo test here

Removing WIP now that cross-repo test is green


Recipe testing for release 2.8.0 - Core release candidate rc1

This issue documents the round of recipe testing performed using the Core release candidate v2.8.0rc1.
Release process

Tool: https://github.com/ESMValGroup/ESMValTool/discussions/3055
Core:  https://github.com/ESMValGroup/ESMValCore/discussions/1924

System and settings
conda/mamba
(base) mamba --version
mamba 1.3.1
conda 23.1.0

Git branches and state
Tue  7 Mar 16:06:43 CET 2023
(base) :~/ESMValTool
$ git status
On branch main
Your branch is up to date with 'origin/main'.

nothing to commit, working tree clean

(base) :~/ESMValCore
$ git status
On branch v2.8.x
Your branch is up to date with 'origin/v2.8.x'.

nothing to commit, working tree clean

Installation and environment
$ cd ~/ESMValTool
$ mamba env create -n tool_280rc1 -f environment.yml
$ conda activate tool_280rc1
$ pip install --editable '.[develop]'
$ cd ~/ESMValCore
$ pip install --editable '.[develop]'

Config user file
Main options: all default except search_esgf: when_missing

output_dir: ./esmvaltool_output
max_parallel_tasks: 8
log_level: debug
exit_on_warning: false
output_file_type: png
remove_preproc_dir: true
compress_netcdf: false
save_intermediary_cubes: false
config_developer_file: null
profile_diagnostic: false

# Site-specific entries: DKRZ-Levante
search_esgf: when_missing
download_dir: /work/bd0854/DATA/ESMValTool2/download
auxiliary_data_dir: /work/bd0854/DATA/ESMValTool2/AUX
rootpath:
  CMIP6: /work/bd0854/DATA/ESMValTool2/CMIP6_DKRZ
  CMIP5: /work/bd0854/DATA/ESMValTool2/CMIP5_DKRZ
  CMIP3: /work/bd0854/DATA/ESMValTool2/CMIP3
  CORDEX: /work/ik1017/C3SCORDEX/data/c3s-cordex/output
  OBS: /work/bd0854/DATA/ESMValTool2/OBS
  OBS6: /work/bd0854/DATA/ESMValTool2/OBS
  obs4MIPs: /work/bd0854/DATA/ESMValTool2/OBS
  ana4mips: /work/bd0854/DATA/ESMValTool2/OBS
  native6: /work/bd0854/DATA/ESMValTool2/RAWOBS
  RAWOBS: /work/bd0854/DATA/ESMValTool2/RAWOBS
drs:
  CMIP6: DKRZ
  CMIP5: DKRZ
  CMIP3: DKRZ
  CORDEX: BADC
  obs4MIPs: default
  ana4mips: default
  OBS: default
  OBS6: default
  native6: default

ESMValTool version
$ esmvaltool version
ESMValCore: 2.8.0rc1
ESMValTool: 2.8.0.dev77+gd0c0c038e

Environment file
tool_280rc1.txt
Compute resources used
On DKRZ-Levante

When possible (small to medium jobs, in practice 4 jobs per node):

#SBATCH --partition=interactive
#SBATCH --mem=64G

Large jobs (nodes not shared)

#SBATCH --partition=compute

Note: no output comparison will be done for this round of testing. The main purpose is to identify issues with the Core and start fixing failing diagnostics. Results and overview webpage will be posted in a later post.

Overview of the results
The first round of recipe testing produced:

109 successful runs (i.e. where a index.html file was generated)
33 failed runs
1 still running

Overview webpage and path to data

Webpage: https://esmvaltool.dkrz.de/shared/esmvaltool/v2.8.0rc1/
Path to the runs on Levante (with preproc dirs for failed runs): /work/bd0854/b309192/recipe_testing/recipe_testing_v2p8/v08rc1/scripts/esmvaltool_output

Note: I will analyse the failures tomorrow, provide a more detailed summary of these failures and only then tag the community and maintainers to provide support in fixing the recipes. Please do not use this issue to comment on single recipe failures but rather open a separate issue, linking to this one. This issue is intended to provide a general overview or discuss recurring problems. More info tomorrow 👍

Overview of the results
Numbers of successes and failures
The first round of recipe testing produced:

115 successful runs (i.e. where a index.html file was generated)
28 failed runs:

7 for missing data/files
13 diagnostic issues, including:

8 failures related to matplotlib recent unpinning and upgrade in our environment #3068
4 failures related to perfmetrics/main.ncl
1 failure related to numpy deprecation

8 preprocessor issues:

several could be due to ESGF facet issues (recipes tested with search_esgf: when_missing)
recipe(s) requiring adaptation after https://github.com/ESMValGroup/ESMValCore/pull/1609
nothing critical at first sight!

For comparison, we released ESMValTool 2.7.0 with 4 non-working recipes (this could have been 8 if we used a stricter policy on missing data as done for this round of testing)
Overview webpage and path to data

Webpage: https://esmvaltool.dkrz.de/shared/esmvaltool/v2.8.0rc1/
Path to the runs on Levante (with preproc dirs for failed runs): /work/bd0854/b309192/recipe_testing/recipe_testing_v2p8/v08rc1/scripts/esmvaltool_output

Note: I will now write three more posts to this issue for each category of failures (missing data, diagnostic issues, preprocessor issues) and provide more details about failures and lists of affected recipes. Please do not use this issue to comment on single recipe failures but rather open a separate issue, linking to this one. This issue is intended to provide a general overview or discuss recurring problems. More info and tagging the community soon 👍

@remi-kazeroni great work on this, bud! I see some manifestations of #3061 - so that might not be just a mocking test error; maybe @bouweandela has some time to look at, at least, anav failure :beer:

Recipe failures due to missing data or files

Recipe
Test run
Problem
Assigned to
Related issue PR

recipe_flato13ipcc
link
known missing data issue
@katjaweigel
#2156

recipe_collins13ipcc
link
new missing data issue: tas, Amon, CMIP5, CSIRO-Mk3L-1-2, [rcp45]
-
-

recipe_tebaldi21esd
link
new missing data issue: pr-tas, Amon, CMIP6, MPI-ESM1-2-HR, ScenarioMIP, ssp370, r*
-
-

recipe_autoassess_landsurface_soilmoisture
link
known missing climatology files (non-public)
@alistairsellar  @valeriupredoi
https://github.com/ESMValGroup/ESMValTool/issues/2309

recipe_schlund20jgr_gpp*
link to one
known retracted data issue
@schlunma
-

For recipe_collins13ipcc and recipe_tebaldi21esd, I would encourage recipe maintainers and friends to open dedicated issues to discuss the problem there and link here by editing the tables.

For recipe_autoassess_landsurface_soilmoisture and recipe_schlund20jgr_gpp*, I would strongly recommend to discuss in the issue #3065 and not here.

Recipe failures due to diagnostic errors

Recipe
Test run
Problem
Assigned to
Related issue PR

recipe_arctic_ocean
link
matplotlib issue
-
-

recipe_autoassess_stratosphere
link
matplotlib issue
-
-

recipe_bock20jgr_fig_1-4
link
diag/preproc issue reading OBS_HadCRUT4
-
-

recipe_bock20jgr_fig_8-10
link
matplotlib issue
-
#3075 should have fixed it (not retested the recipe)

recipe_carvalhais14nat
link
matplotlib issue
-
-

recipe_esacci_lst
link
ancestor taks issue
-
-

recipe_hype
link
numpy issue
-
-

recipe_monitor
link
matplotlib issue
-
-

recipe_perfmetrics_CMIP5*
link to one
issue with perfmetrics/main.ncl
-
-

recipe_smpi*
link to one
issue with perfmetrics/main.ncl
-
-

recipe_sea_surface_salinity
link
matplotlib issue
-
-

All these are new issues discovered in the release process of v2.8.0. I would encourage recipe maintainers and friends to open dedicated issues to discuss the problem there and link here by editing the tables.

There are different types of "matplotlib issues". These are issues still existing after #3075 was merged and used for the testing.

If needed some problems could be moved to the preprocessor issues table (recipe_bock20jgr_fig_1-4 and recipe_esacci_lst)

Recipe failures due to preprocessor errors

Recipe
Test run
Problem
Assigned to
Related issue PR

recipe_anav13jclim
link
issue with weighting_landsea_fraction for OBS data
@bouweandela and @schlunma (fix in v2.9?)
see description of PR https://github.com/ESMValGroup/ESMValCore/pull/1609

recipe_autoassess_radiation_rms_cfMon_all
link
known CMOR check issue with CMOR checks
-
https://github.com/ESMValGroup/ESMValCore/issues/1238 but won't fix for v2.8?

recipe_check_obs
link
known derivation issue for ERA5
-
see https://github.com/ESMValGroup/ESMValCore/issues/1388

recipe_climate_change_hotspot
link
new from_datasets.py issue
-
-

recipe_meehl20sciadv
link
new _io.py concatenation issue
-
-

recipe_russell18jgr
link
new preprocessor/_supplementary_vars.py issue
-
-

recipe_schlund20esd
link
new _io.py concatenation issue
-
-

recipe_wenzel16jclim
link
new preprocessor/_supplementary_vars.py issue
-
-

I have the impression that some (all?) the 4-5 recipes could be run successfully when using search_esgf: never, i.e. without ESGF data. Said differently, some of the listed preprocessor issues could be ESGF facet issues...

The last 5 failures are new issues discovered in the release process of v2.8. I would encourage recipe maintainers and friends to open dedicated issues to discuss the problem there and link here by editing the tables.

Hi @ESMValGroup/esmvaltool-developmentteam and @ESMValGroup/esmvaltool-recipe-maintainers, the results from the first round of recipe testing for the release of ESMValTool and ESMValCore v2.8 are now available. See summary and link to the overview webpage in this https://github.com/ESMValGroup/ESMValTool/issues/3076#issuecomment-1460111541 above.
It would be great if you could take a look at the results of your favourite recipes and help fixing the failing ones. In such cases, please assign yourselves in the tables above and if possible open separate issues to discuss the problems. Feel free to comment here if you have noticed other problems with the recipe output.
There are 3 main categories of failures:

missing data issues
diagnostic issues
preprocessor issues

Any help will be greatly appreciated 👍
Please tag me in the PRs for recipe fixing, I can take a look and merge them into the main and release branches. Thanks in advance for your support!

@remi-kazeroni my apologies - for the autoassess soilmoisture recipe, I plopped the clima files at /home/b/b382109/autoassess_files - just did a run with the new rc1 and that recipe runs well! If you want me to, I can put those files elsewhere, if you don't have access to them from me HOME dir :+1:

@remi-kazeroni my apologies - for the autoassess soilmoisture recipe, I plopped the clima files at /home/b/b382109/autoassess_files - just did a run with the new rc1 and that recipe runs well! If you want me to, I can put those files elsewhere, if you don't have access to them from me HOME dir +1

Thanks for checking, good to know it runs fine +1
We have started to discuss how to handle this recipe in the issue on the broken recipe policy #3065 (see this #3065 (comment)). If the clima files cannot be publicly accessed and if that access cannot be documented, we will always have trouble testing such recipes for releases.
Remember that we have discussed a lot already to avoid these manual steps where the release manager would need to search for extra files to run particular recipes. This makes the release process too complicated otherwise. I think you have a PR that aims at simplifying the description of the release process: #3032 (I'm going to push it to the finish line soon) +1

totally with you on that, bud! ah that #3032 - had forgotten about it :grin: BTW great work streamling it, such a socialist/community PR :hammer_and_pick:

Thanks everyone for your support with fixing recipes! Most failed recipes have received some attention and many of them got fixed already. That's great news for the upcoming release 👍
Up to now, it seems that 2 recipes have unfortunately not received attention:

recipe_arctic_ocean

  File "/home/b/b309192/ESMValTool/esmvaltool/diag_scripts/arctic_ocean/utils.py", line 223, in get_cmap
    cm.register_cmap(cmap=LinearSegmentedColormap(
  File "/work/bd0854/b309192/soft/mambaforge/envs/tool_280rc1/lib/python3.10/site-packages/matplotlib/_api/deprecation.py", line 200, in wrapper
    return func(*args, **kwargs)
  File "/work/bd0854/b309192/soft/mambaforge/envs/tool_280rc1/lib/python3.10/site-packages/matplotlib/cm.py", line 263, in register_cmap
    _colormaps.register(cmap, name=name, force=override_builtin)
  File "/work/bd0854/b309192/soft/mambaforge/envs/tool_280rc1/lib/python3.10/site-packages/matplotlib/cm.py", line 136, in register
    raise ValueError(
ValueError: A colormap named "cubehelix3" is already registered.

recipe_carvalhais14nat

Traceback (most recent call last):
  File "/home/b/b309192/ESMValTool/esmvaltool/diag_scripts/land_carbon_cycle/diag_global_turnover.py", line 817, in <module>
    main(config)
  File "/home/b/b309192/ESMValTool/esmvaltool/diag_scripts/land_carbon_cycle/diag_global_turnover.py", line 755, in main
    _plot_single_map(plot_path_mod, tau_ctotal,
  File "/home/b/b309192/ESMValTool/esmvaltool/diag_scripts/land_carbon_cycle/diag_global_turnover.py", line 660, in _plot_single_map
    _fix_map(_ax)
  File "/home/b/b309192/ESMValTool/esmvaltool/diag_scripts/land_carbon_cycle/diag_global_turnover.py", line 278, in _fix_map
    plt.gca().outline_patch.set_visible(False)
AttributeError: 'GeoAxes' object has no attribute 'outline_patch'

If you happen to know their maintainers or colleagues/friends or if you have encountered similar diagnostic issues recently, you are most welcome to jump in here and help us getting the recipes fixed for the upcoming release. Otherwise these would be marked as broken in ESMValTool v2.8.

@remi-kazeroni hold on tight buddy, Carvalhais will get a solution in the next few minutes, I know exactly what's up there

Carvalhais needs to get back to the other patches - @zklaus fixed that for when we pinned Matplotlib last release, see https://github.com/ESMValGroup/ESMValTool/issues/2886#issuecomment-1292135500 - now we need to revert that, I'll PR it now

Carvalhais14 fixed here https://github.com/ESMValGroup/ESMValTool/pull/3111

Hi, I looked at the recipe_arctic_ocean log, and apparently the cm.register_cmap function has been deprecated in matplotlib since version 3.7 (see https://matplotlib.org/stable/api/cm_api.html#matplotlib.cm.register_cmap )
and is suggested to be replaced by matplotlib.colormaps.register. Could it be a case of just replacing the deprecated function?
Unfortunately, I'm not able to run any test at the moment. The Norwegian national data storage is migrating all data to a new location, and have closed down access for some time.

colormaps.register

Hi @TomasTorsvik, thanks very much for taking a look and your suggestion! It would be great if you or someone could make these modifications available in a branch and open a (draft) pull request with that. This would then ease the testing for developers like me with access to all necessary data at DKRZ. Note that you could also make use of our bot directly from that PR (see doc). This would allow you to request a fresh installation of ESMValTool and a test run at DKRZ directly via the PR.

Thanks everyone for you help and support with fixing recipes! All cases have now been addressed. I'm closing this and will open tomorrow another issue for the second and last round of testing (currently ongoing) where the community will be asked to take a look at recipe output and status of the comparison with results from the previous release.

legend @remi-kazeroni :medal_military: Hopefully the next (and last) round will be a cake walk :cake:


Support sys-v init on all platforms

Our current init script is platform dependent. This PR gives us a LSB standard script and includes additional testing so we can make sure we can do sys-v everywhere.

Rebase?


Add gentle intro to HARK notebook with test

Copied notebook file from https://github.com/econ-ark/DemARK/blob/master/notebooks/Gentle-Intro-To-HARK.ipynb
Fixed so it can run (previously failed on cell containing plotFuncs(PFexample.solution[0].cFunc,mPlotBottom,mPlotTop) since it referenced mPlotBottom which was supposed to be input by user- users should put in a value and then uncomment the line using it)
Added a test which programmatically runs the notebook and asserts it runs without error
Manually tested running all cells of the notebook in jupyter completes without error as well

Is there a way to test run a notebook in DemARK without copying it into HARK?

Added update to travis config so that it runs the new test

Is there a way to test run a notebook in DemARK without copying it into HARK?

Certainly, but there are trade offs in other solutions which avoid copying it in since that will add complexity elsewhere. I would ask- what is the benefit of of having DemARK in a separate repo? To me this was confusing- having some simple examples right in this repo seems like a useful thing in general to onboard people to the project.

Thanks for this!  We plan to revamp the DemARKs so that there are "interactive learning" versions like the Gentle Intro is now (where by interactive we mean that in order to proceed beyond a certain point, the user has to input something) and versions with that material stripped out.
We are planning to consolidate our repos and in the consolidation DemARK will
probably become a component of HARK.
One reason we wanted to have DemARK and REMARK separate is that the requirements for MyBinder use of them are different -- some of the REMARKs require a pretty heavy setup cost that is not necessary for the lightweight DemARKs and we didn't want to slow the loading of DemARK's unnecessarily.  But we can probably find ways around those problems.

Consolidating makes a lot of sense to me- heavier notebooks could still remain in separate repos IMO while having a few canonical ones in the main repo would be handy.

One question: In .travis.yml, you change pytest HARK/tests just to pytest. I'm guessing that this is because HARK/tests is the default place for the tests to be, and so the path is not needed?

I changed that because I put the example and test under Examples/ instead of HARK/. There was no reason to really have it target HARK/tests in the first place, since pytest can automatically discover tests without you telling it specific places to look.  pytest HARK/tests -> pytest just lets it discover any tests in the repo.

PS. We intend to do systematically what you have done for this instance: Make "testable" versions of notebooks that currently require user input. But rather than pulling this example into the master branch, I think it is best to leave it as a PR to remind us that this is on the agenda to do generically. Eventually the gentle-intro will be included among all the changes of this kind.

Makes sense to me

On Mon, Jun 10, 2019 at 6:19 PM Keith Blaha<EMAIL_ADDRESS>wrote:

One question: In .travis.yml, you change pytest HARK/tests just to pytest.
I'm guessing that this is because HARK/tests is the default place for the
tests to be, and so the path is not needed?
I changed that because I put the example and test under Examples/ instead
of HARK/. There was no reason to really have it target HARK/tests in the
first place, since pytest can automatically discover tests without you
telling it specific places to look. pytest HARK/tests -> pytest just lets
it discover any tests in the repo.

I see -- so it just looks inside any directory named "tests" wherever it
might be?
Good to know.  (As you can tell, I'm just beginning to get up to speed on
unit testing!)
PS. We intend to do systematically what you have done for this instance:

Make "testable" versions of notebooks that currently require user input.
But rather than pulling this example into the master branch, I think it is
best to leave it as a PR to remind us that this is on the agenda to do
generically. Eventually the gentle-intro will be included among all the
changes of this kind.
Makes sense to me

Thanks again for your contributions.
One other question:  You seem to have copied util.py from /lib to
/Examples.  I'm not quite sure why we have it in /lib rather than, say, in
HARK.utilities.  But given that it is in /lib, what was the rationale for
putting a copy in /Examples?

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/econ-ark/HARK/pull/280?email_source=notifications&email_token=ABSEEJGIWOYN2LTSG4WN7KLPZZ5IFA5CNFSM4HLJZTP2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODXKLQFQ#issuecomment-500480022,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABSEEJE7PQPFKHJKZ24DHO3PZZ5IFANCNFSM4HLJZTPQ
.

--

Chris Carroll


How can I create user in graphite 0.10

Dear All,
I have installed graphite 0.10 on my CentOS 7, but I don't know how to login. I don't want to use LDAP and Remote User Login, I setup with local login.
I have searched on google, I found one way to create user by sung manage.py script in /opt/graphite/webapp but I can not see this script in my installation.
I don't know what is the problem.
Hope that someone will help me.
Thanks.

You need to add the manage.py from the .9x branch and change the settings to graphite.settings. I'll add a pull request


Remove macOS memory leaks when writing to the clipboard

This PR removes the long-outstanding memory leaks in the macOS clipboard backend. After some experimentation, I found that these methods had leaky implementations:

set_string
set_image
set_html

None of the reading functions had leaks AFAICT.
The root cause of (most) the issues was that several calls to msg_send! were not passing their arguments correctly. Instead of passing a pointer to the relevant Objective-C object to a class function, they passed the value itself via move. This worked before since the value could still be read by the system, but it became problematic with memory usage. As the system functions only expected a reference to the data, none of them attempted to free it since this would lead to a use-after-free or double-free in user code. So to Rust's eyes, the value was moved across the FFI boundary and never had their destructors called, essentially the same if mem::forget had been used.
To resolve these problems, I corrected the callsites to pass a reference/pointer across like the APIs expected.
The other issue was that when creating an NSImage class allocation, the previous code was accidentally increasing the reference count after allocating instead of taking ownership. This resulted in an unbalanced retain count that meant the resulting class could never be freed. Allocating a class always has at least one reference, otherwise it would be instantly reclaimed by the runtime. Our user code becomes the object's new owner once the runtime has finished preparing it.
Relates to #24

This PR does not fix all of the reported issues like I originally hoped, but these are still valid leaks that should be fixed, so I'm going to merge this in parallel with investigating the getter leaks.

Thank you for your work! @complexspaces


Introduce a fail-safe mechanism for the parser and error recorvery

Description:
Currently both the parser and error recovery have paths that are not supposed to be reached. Such invalid states cause runtime errors at the moment. i.e.: parser get crashed.
However, for some unforeseen reason, if the parser/error-recovery comes to a such an unhandled-state, the parser would crashed, and this is not an acceptable behaviour from a user's perspective. Therefore, instead of throwing a runtime error, implement a mechanism to recover from a unhandled path as well.
This is more of a fail-safe. Hence the requirement is only to be able to produce a valid tree, without the parser getting crashed. The recovered tree doesn't need to be the optimal one.

Considering the worst case scenario,

I am thinking may be we can replace all the throw new IllegalStateException("cannot find the next rule for: " + currentCtx); in the error handler with assert true; and use an appropriate rule as the next rule in that context, thus error handler will never crash in the production.

I have done this in one small place,

https://github.com/ballerina-platform/ballerina-lang/blob/ef94a2b65dbe5ba6a50f16c22319fb2b0283bd42/compiler/ballerina-parser/src/main/java/io/ballerina/compiler/internal/parser/BallerinaParserErrorHandler.java#L3443-L3446

But that way, it tends to create an inconsistency between parser and error handler, when trying to parse for such scenario.

But, with the combination of other fail-safe-mechanism we introduced in PR #24242, in case of inconsistency that token will be dropped.

Worst comes to the worst; if both fail-safe-mechanisms keep continue triggering, we can consider giving a parser timeout?

Considering the worst case scenario,

I am thinking may be we can replace all the throw new IllegalStateException("cannot find the next rule for: " + currentCtx); in the error handler with assert true; and use an appropriate rule as the next rule in that context, thus error handler will never crash in the production.

I have done this in one small place,

https://github.com/ballerina-platform/ballerina-lang/blob/ef94a2b65dbe5ba6a50f16c22319fb2b0283bd42/compiler/ballerina-parser/src/main/java/io/ballerina/compiler/internal/parser/BallerinaParserErrorHandler.java#L3443-L3446

But that way, it tends to create an inconsistency between parser and error handler, when trying to parse for such scenario.

But, with the combination of other fail-safe-mechanism we introduced in PR #24242, in case of inconsistency that token will be dropped.

Worst comes to the worst; if both fail-safe-mechanisms keep continue triggering, we can consider giving a parser timeout?

You could also let the exception be thrown, then catch and handle it. Two places to handle:

Like you've said, when visiting alternative paths, one path could be throwing an exception. Can catch the exception there (where the alternatives are visited) and simply ignore that path. The best alternative path would get picked from the remaining contenders.
At the entry point (exception can be thrown without going for alternative paths) - Catch the exception and provide the solution as a REMOVE. That guarantees the parser won't get stuck at the same place.

Nice idea to have the assert fail in such cases. +1 for that.
Could add it to the places where the exception is caught.

You could also let the exception be thrown, then catch and handle it. Two places to handle:

Like you've said, when visiting alternative paths, one path could be throwing an exception. Can catch the exception there (where the alternatives are visited) and simply ignore that path. The best alternative path would get picked from the remaining contenders.
At the entry point (exception can be thrown without going for alternative paths) - Catch the exception and provide the solution as a REMOVE. That guarantees the parser won't get stuck at the same place.

Nice idea to have the assert fail in such cases. +1 for that.
Could add it to the places where the exception is caught.


205 | Isomorphic Strings | Python

Title - 205. Isomorphic Strings
What will change - Adding solution
Type of Issue -
Please add/delete options that are not relevant.

[x] Adding New Code
[ ] Improving Code
[ ] Improving Documentation
[ ] Bug Fix

Programming Language
Please add/delete options that are not relevant.

[x] Python
[ ] C++
[ ] Java
[ ] SQL

Please assign it to me.

[x] Assigning to @wpedrak


Problem job

Hi, i indicate a new problem, if i have a job and i choose other job i have the old job..
Ex: I'm police man an i choose medic, i have medic and police in job
I have try to set the gtype for police in "police" and after for medic in "medic" and inverse.. "job" for all jobs, but its same

I haven't problems from my side, check your configuration and if players has double groups in the database.

Ok ^^, but what is the good config ?? gtype in job for all jobs or police for police man and medic for medic ??

Get the default config from fresh install of vRP and look in groups.lua cfg.

Ok ^^


Wallet couldn't  connect to internet

Hello!
Qt wallet couldn't connect to internet. Pc have internet through router, ip - dns. I tried to compile many times with UPNP and without UPNP - no differnet. What i need do?
Thanks.
Sorry for my English.

Wallet find connection.


[Question] Modify CSS in Shoelace

Hi @sidharthramesh
I want to style inside the <sl-input> but there is a <mb-input> parent.
Is there a way to access the Shadow DOM in sl-input?
Thank you.

Hey @prillymonials, this is not currently possible. But if the mb-input exposes the sl-input as a part, you can customize it using CSS part selectors.. If you want to select parts deeper inside sl-input, we'll have to use exportparts.
I'm open to a PR on this. Exposing parts partially has been done for a few elements already.


Development: add Material for MkDocs as example

I added Material for MkDocs example to have it hand. I had to fix some small pre-commit issue.

It might be helpful to document how this example was created, so that we understand how to update it in the future and what pieces are critical for addons.

Yes. I wasn't sure what to do here and I went for the quick and simple direction for now: upload a built site 😅
I would like to have the sources and the resulting HTML built together, but I thought I was kind of duplicating what we have in test-builds [^1]. So, I thought that we should probably find a way to integrate both repositories instead of duplicating the work.
I'd like to think a little more about this idea. Maybe it's just a Git submodule with a README with instructions on how to build each of them.
[^1]: by the way, this example was created with the mkdocs-material branch from test-builds 😄

I included these 3 examples here to have them at hand to do quick tests, but I'm happy to expand the idea to pattern that works better.

I opened https://github.com/readthedocs/addons/issues/203 to think more about this.

It might be helpful to document how this example was created,

Meh, I forgot that I have also pushed the sources to examples/ directory. So, I should do the same for MkDocs since they are a few set of files.


Allow plugins to add multiple tabs

What this PR does / why we need it:
This is a non-breaking API change that allows plugin authors to add multiple tabs from a single plugin. Plugins will still be displayed in lexical order as they are sorted with tabs potentially from other plugins.
options := []service.PluginOption{
	service.WithTabPrinter(handleTab, handleTab2, handleTab3),
}

Which issue(s) this PR fixes

Fixes #1440

Signed-off-by: Sam Foo<EMAIL_ADDRESS>

Merging so npm libraries can cut an update if desired.

Bad review from me previously, I completely missed that the TabResponse object in the jsPlugin.PrintTabs method was hard coded to a single tab. So even with the typescript updates, the JS plugins won't be able to generate multiple tabs.
Sorry about that, I'll open for that and see about getting that implemented along side the TS libraries.
https://github.com/vmware-tanzu/octant/blob/master/pkg/plugin/javascript.go#L399


fixes nulls appearing in list of emails with secondary emails

@JMurphyWeb @ivanmauricio Please try this out and verify it fixes the problem

@rjmk looks good!


traitor: init at 0.0.3

Motivation for this change
Automatic Linux privilege escalation
https://github.com/liamg/traitor
Related to #81418
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 119792 run on x86_64-linux 1

1 package built:

traitor


Expose service client and app isolate in driver

Description
Advanced clients would like to register and call their own extensions via Driver. Instead of expecting them to build their own VMIsolate object, we should let them reuse the one constructed in Driver.
This is not a breaking change.

@ekarayel FYI

Note: This makes the VMServiceClient a part of FlutterDriver's public API. This means that upgrading that dependency will be a breaking change if the underlying library's API has a breaking change.
Given that this package does not seem to have an API that is as stable as FlutterDriver itself it seems like it could cause future pain to expose this in this way.
This was why the original feature request was to get the vm service URL rather than the object itself.

Someone pointed out that VMIsolate is already exposed through FlutterDriver.connectedTo so I think my last point is invalid.


✨ Pausing a Space

See https://github.com/huggingface/moon-landing/pull/5276

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.


[ECS] Skipper - remove global code skip from unused

Closes #778

Ping @enumag

@TomasVotruba Looks good. I'd probably use realpath() function instead of SplFileInfo but that's detail. Can you release a new version with this fix? The bug is a bit annoying.

@TomasVotruba Looks good. I'd probably use realpath() function instead of SplFileInfo

I agree it would be shorter.
Thinking one step ahead, the goal is to use SplFileInfo in the whole codebase. That way relative paths, absolute paths, and other information are available everywhere and don't have to be hacked this way.
Maybe place for a new issue.

Can you release a new version with this fix? The bug is a bit annoying.

I'll get to it

Thinking one step ahead, the goal is to use SplFileInfo in the whole codebase. That way relative paths, absolute paths, and other information are available everywhere and don't have to be hacked this way.

Yeah that sounds good. :+1:

Done, 4.1 is out: https://github.com/Symplify/EasyCodingStandard/releases/tag/v4.1.0
Please test and let me now


chore: release v13

This PR is meant to collect the changes that will go into the next major release.
Fixes: #6823
fixes: https://github.com/zwave-js/node-zwave-js/issues/6794
fixes: https://github.com/zwave-js/node-zwave-js/issues/6772
fixes: https://github.com/zwave-js/node-zwave-js/issues/6627
Migration guide: https://github.com/zwave-js/node-zwave-js/blob/v13/docs/getting-started/migrating-to-v13.md

@zwave-js-bot automerge

rebased manually


fix(logging): increase logs to identify the issue #9

:tada: This PR is included in version 1.5.1 :tada:
The release is available on:

GitHub release
v1.5.1

Your semantic-release bot :package::rocket:


[S2GRAPH-215] Implement a Storage Backend for JDBC driver, such as H2, MySql using the Mutator and Fetcher interfaces.

Implement EdgeMutator and EdgeFetcher for JDBC interface.
I chose the H2 DB(org.h2.Drvier) as the JDBC Driver implementation.
The current implementation is to work for each Label according to the Label option.
I plan to move to the storage level later.
Lable option example
{
  "fetcher": {
    "className": "org.apache.s2graph.core.storage.jdbc.JdbcEdgeFetcher",
    "url": "jdbc:h2:file:/tmp/s2graph/metastore;MODE=MYSQL",
    "driver": "org.h2.Driver",
    "password": "sa",
    "user": "sa"
  },
  "mutator": {
    "className": "org.apache.s2graph.core.storage.jdbc.JdbcEdgeMutator",
    "url": "jdbc:h2:file:/tmp/s2graph/metastore;MODE=MYSQL",
    "driver": "org.h2.Driver",
    "password": "sa",
    "user": "sa"
  }
}

Implemented functionality.

Basic Edge CRUD with Strong, Weak consistency option.

TODO:

Implement VertexMutator, VertexFetcher
Other JDBC support, including PostgreSQL

@daewon +1, I left a comment, can you please take a look at it?


Scratchblocks integration

Sorry for all the "issues" but here's another idea:
What about scratchblocks previews? Was this already planned?

We could ask permission from ST and take their Scratchblocks :smile:

I think somebody called blob(numbers) developed ScratchBlocks.

The code is open source right here on GitHub: https://github.com/blob8108/scratchblocks2 It's under an Mit license, so we are free to use it how we wish as long as the license is respected and included with every copy.

:) http://blob8108.github.io/scratchblocks2/#when green flag clicked
move (10) steps
say [Here's a working demonstration]
So anyway, any ideas on how to implement it?

I've forked it into our org to tinker with it: https://github.com/OpenSprites/scratchblocks2
We could use it to render the uploaded scripts into the webpage so we won't need images?

That's what I was thinking, yeah.

The sprite images don't seem to load correct @ my end

Only some do for me.

I'm already implementing scratchblocks in my thing that pulls resources from Scratch projects, as I suggested earlier.


Question of the interpretation of the model output

In the model.py more precisely in def YoloV3() output_0, output_1 and output_2 are generated. As far as I understand it correctly these are the corresponding feature maps.
These feature maps have the following dimensions 13 x 13 x 85, 26 x 26 x 85 and 52 x 52 x 85. The first two numbers stand for the grid and the 85 contains the following information 𝑝𝑐,𝑏𝑥,𝑏𝑦,𝑏ℎ,𝑏𝑤 and the remaining 80 numbers stand for the classes.
Now to my question: in which order are the classes of the 80 digits? Is it the same order as in the corresponding coco.names file? So can I assume that the first digit of the eighty digits stands for the class "person" and the second digit for "bicyle" ?

thats only half correct, you can see the code here
https://github.com/zzh8829/yolov3-tf2/blob/d63a9921a42dce04cd74ddb529926f9ff81bc41a/yolov3_tf2/models.py#L154
the 85 are bx,by,bw,bh,object follow by 80 classes
in the 80 digits they are indeed same order of names file


Ballot without reputation

I'm being asked to submit a ballot even though I have zero reputation; this is nonsensical. It's possibly useful / informative to show what the ballot is even though I can't submit one, but if so then it should be abundantly clear to the user that this is the case, and that submitting a ballot is not required and won't do anything (or is impossible, whatever the case is).

So far I can’t reproduce it.  Confirmed that hosted geth works seamlessly with node js instead of pulling from hosted - BUT mongodb hosted runs great.  I had to removed db and resync to see where things are at.  Takes FOREVER to get the IPC rolling - i spend maybe 25 minutes then magically my machine whirls to life.   I started by running the localhost code then tried the client.augur < which is out of date << is divshot the equivalent of staging/beta testing and Client is the stable well tested version?

If you're making requests to geth directly from the browser, you're using RPC instead of IPC.  (IPC unfortunately doesn't work from the browser.)  It's definitely true that even localhost RPC is too slow at this point, and will only get worse as the number of markets grows.  Trying to solve this problem in 2 ways: 1) using a decentralized cache instead of MongoDB (#198), and 2) using a small server-side process that could use IPC to communicate with geth (#194).

Unable to reproduce this; closing for now.

I also have 0 rep but have a ton of ballots to report


Request For Tagalog Translation

Please go to Stack Overflow for help and support:
https://stackoverflow.com/questions/tagged/tensorflow
If you open a GitHub issue, here is our policy:

It must be a bug, a feature request, or a significant problem with documentation (for small docs fixes please send a PR instead).
The form below must be filled out.
It shouldn't be a TensorBoard issue. Those go here.

Here's why we have that policy: TensorFlow developers respond to issues. We want to focus on work that benefits the whole community, e.g., fixing bugs and adding features. Support only helps individuals. GitHub also notifies thousands of people when issues are filed. We want them to see you communicating an interesting problem, rather than being redirected to Stack Overflow.

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow):
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
TensorFlow installed from (source or binary):
TensorFlow version (use command below):
Python version:
Bazel version (if compiling from source):
GCC/Compiler version (if compiling from source):
CUDA/cuDNN version:
GPU model and memory:
Exact command to reproduce:

You can collect some of this information using our environment capture script:
https://github.com/tensorflow/tensorflow/tree/master/tools/tf_env_collect.sh
You can obtain the TensorFlow version with
python -c "import tensorflow as tf; print(tf.GIT_VERSION, tf.VERSION)"
Describe the problem
I want to help in the Translation for Tagalog version so that this project will be available in our country. Hope you'll grant my request.
Source code / logs

@MarkDaoust is it possible for external contributors to help with docs translations?

We're working on a plan for translation infrastructure. It's something we know we need to do. I'm closing this since we don't need a bug per language.
@ewilderj do you know of any community translation efforts in the mean time?

@MarkDaoust I haven't any personal experience with it, but Red Hat has a tool called Zanata that can be used for both docs and software http://zanata.org/
I am very interested in how we can organize community contribution to documentation. We have a large opportunity with China, for instance.

FYI we just released our ML course.


GH-1732: Fix Listener Container Parser

Resolves https://github.com/spring-projects/spring-amqp/issues/1372
Do not split queue-names in the parser - leave it to Spring's type converter.
Also support SpEL in queues; a more elegant solution would require major
refactoring of the parser; so this is just a compromise.
cherry-pick to 2.3.x, 2.2.x

... and cherry-picked to 2.3.x & 2.2.x


Shameless rip-off

This repository, or the biggest part of it, appears to be a shameless rip-off of other people's code, with the copyright information removed. The original work, as far as I could trace it back, seems to be https://github.com/kevzlou7979/select2-materialize
Maybe @kevzlou7979 wants to check this and probably take according actions.

Ok, i can't get it why you write it after 3 years of repository creation.  It's true, plugin uses that repo, added information in readme.

Ok, i can't get it why you write it after 3 years of repository creation.

Because I don't walk around investigating random GitHub repositories :D.


[Doc] API Document generation

Implemented in Build#104, added shortcut to documents in start menu.


[BUG] Fix menu icons

Describe the bug
With release v0.23.0-rc.1, the caret icons in the sidebar menu are no longer working. This is possibly related to a fix required for Hugo v0.123.8.
To reproduce
Steps to reproduce the behavior:

Go to 'https://gethinode.com/docs/getting-started/introduction/'
Inspect the menu on the left

Host environment
Please complete the following information where applicable.

Hinode version: [e.g. v0.23.0-rc.1]

Hugo environment
Copy the output of hugo env or npm run env here.
hugo v0.123.8-5fed9c591b694f314e5939548e11cc3dcb79a79c+extended darwin/arm64 BuildDate=2024-03-07T13:14:42Z VendorInfo=brew
GOOS="darwin"
GOARCH="arm64"
GOVERSION="go1.22.1"
github.com/sass/libsass="3.6.5"
github.com/webmproject/libwebp="v1.3.2"
github.com/sass/dart-sass/protocol="2.5.0"
github.com/sass/dart-sass/compiler="1.72.0"
github.com/sass/dart-sass/implementation="1.72.0"

Additional context
Add any other context about the problem here.

Solved with release v0.23.0-rc.4


Create backup strategy for live test pipeline secrets

We have several hundred secrets used for live test provisioning across the language SDKs (subscription/SP configs, connection strings, etc.). Currently these are persisted in two places: keyvault, and the cache that azure pipelines keeps for secret variables. It would be ideal if we had a backup keyvault or some other method to ensure it's harder to accidentally remove them.

While we haven't put a backup strategy in place for this, we did put a delete lock on the KeyVault used for live test pipelines.  Further, all KeyVault deletes are "soft deletes" which means you have 30 days to recover it before the data is lost.  It's actually super hard to delete a KeyVault and make it be "gone" instantly.  Like, I can't even do it in the UI at all to my knowledge. :)


Optimization: Concatenating PrimitiveArrays

This optimization merges all PrimitiveArrays in each render queue, so that all patches are first rendered with pass 1, then pass 2, etc, instead of constantly switching passes. In order to do this, I made the array of lightmap textures into a Texture2DArray instead, and inserted the index into this array into each patches PrimitiveArray before concatenating (using the new ToVertex Float instance from GPipe 2.1.6) so that the right lightmap can be selected during shader execution.
This optimization reduces number of GL-calls from 120k to 20k, so a reduction of more than 80%! Each drawcall is now much cheaper, but the number of drawcalls doesn't change with this (4222(!)). The next step would be to attack that, eg by BSP-tree culling.

Worth mentioning is that I haven't released GPipe 2.1.6 yet, so you'll have to sync the github repo for that :)

It seems that the lightmap merge optimization has some problem:

Oops, should be fixed on HEAD of GPipe-Core now.

The bug I just fixed pushed up GL API call count to 25k...

Hm, found more bugs, but this time in the changes I made to your code, will fix and send another pull request


 when not run with elevated privileges (sudo)

I think I've found a bug where if Greenlight is run normally (clicking on the icon) it will never fully load the stream. However, if the app is run through the terminal with elevated privileges, the stream will run. Here are my specs:
MacBook Pro 16 M1
MacOS 14.0 Beta (23A5337a)
Logs for Error and Success attached.
Greenlight_Error_Loading_TerminalOutput.txt
Greenlight_Success_Stream_TerminalOutput.txt

I think this is a duplicate of https://github.com/unknownskl/greenlight/issues/896.


Improve rendering multi-line diagnostic messages

This would, for example, be useful for Haskell diagnostics. A mapping to open the message in a floating window would also be good to have.

If it is at all helpful, please feel free to reuse any code you like from: https://github.com/cseickel/diagnostic-window.nvim

Awesome, thanks!