Failing to export

[/] I am on the latest Poetry version.
[/] I have searched the issues of this repo and believe that this is not a duplicate.
[/] If an exception occurs when executing a command, I executed it again in debug mode (-vvv option).

OS version and name:
Poetry version:
Link of a Gist with the contents of your pyproject.toml file:

Issue

I have a CI/CD that use serverless and usePoetry: True, just 3 days ago it was working. But right now it's failing.
Error:
Error: `poetry export --without-hashes -f requirements.txt -o requirements.txt --with-credentials` Exited with code 1
    at ChildProcess.<anonymous> (/usr/local/lib/node_modules/serverless-python-requirements/node_modules/child-process-ext/spawn.js:38:8)
    at ChildProcess.emit (node:events:513:28)
    at ChildProcess.emit (node:domain:489:12)
    at maybeClose (node:internal/child_process:1093:16)
    at Process.ChildProcess._handle.onexit (node:internal/child_process:302:5)

poetry -vvv export --without-hashes -f requirements.txt -o requirements.txt --with-credentials
Here's the -vvv Result

Project environment contains an empty path in sys_path, ignoring.
Source (poetry-locked): 1 packages found for fastapi 0.75.2
Source (poetry-locked): 1 packages found for sqlalchemy >=1.4.23,<2.0.0
Source (poetry-locked): 1 packages found for uvicorn >=0.15.0,<0.16.0
Source (poetry-locked): 1 packages found for fastapi-jwt-auth >=0.5.0,<0.6.0
Source (poetry-locked): 1 packages found for python-jose >=3.3.0,<4.0.0
Source (poetry-locked): 1 packages found for passlib >=1.7.4,<2.0.0
Source (poetry-locked): 1 packages found for pydantic >=1.8.2,<2.0.0
Source (poetry-locked): 1 packages found for alembic >=1.7.1,<2.0.0
Source (poetry-locked): 1 packages found for itsdangerous >=2.0.1,<3.0.0
Source (poetry-locked): 1 packages found for pusher >=3.0.0,<4.0.0
Source (poetry-locked): 1 packages found for pendulum >=2.1.2,<3.0.0
Source (poetry-locked): 1 packages found for httpx >=0.19.0,<0.20.0
Source (poetry-locked): 1 packages found for slowapi >=0.1.5,<0.2.0
Source (poetry-locked): 1 packages found for mangum >=0.12.2,<0.13.0
Source (poetry-locked): 1 packages found for psycopg2-binary 2.9.1
Source (poetry-locked): 1 packages found for postmarker >=0.18.2,<0.19.0
Source (poetry-locked): 1 packages found for sentry-sdk >=1.3.1,<2.0.0
Source (poetry-locked): 1 packages found for dramatiq >=1.11.0,<2.0.0
Source (poetry-locked): 1 packages found for periodiq >=0.12.1,<0.13.0
Source (poetry-locked): 1 packages found for sqlalchemy-utils >=0.37.8,<0.38.0
Source (poetry-locked): 1 packages found for pytest-mock >=3.6.1,<4.0.0
Source (poetry-locked): 1 packages found for flask >=2.0.1,<3.0.0
Source (poetry-locked): 1 packages found for flask-caching >=1.10.1,<2.0.0
Source (poetry-locked): 1 packages found for requests-aws 0.1.8
Source (poetry-locked): 1 packages found for stripe >=2.63.0,<3.0.0
Source (poetry-locked): 1 packages found for google-auth >=2.3.3,<3.0.0
Source (poetry-locked): 1 packages found for sendgrid >=6.9.4,<7.0.0
Source (poetry-locked): 1 packages found for pyyaml >=6.0,<7.0
Source (poetry-locked): 1 packages found for ua-parser >=0.10.0,<0.11.0
Source (poetry-locked): 1 packages found for user-agents >=2.2.0,<3.0.0
Source (poetry-locked): 1 packages found for cloudpathlib >=0.9.0,<0.10.0

  Stack trace:

  14  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/cleo/application.py:329 in run
       327│
       328│             try:
     → 329│                 exit_code = self._run(io)
       330│             except Exception as e:
       331│                 if not self._catch_exceptions:

  13  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/poetry/console/application.py:185 in _run
       183│         self._load_plugins(io)
       184│
     → 185│         exit_code: int = super()._run(io)
       186│         return exit_code
       187│

  12  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/cleo/application.py:423 in _run
       421│             io.input.set_stream(stream)
       422│
     → 423│         exit_code = self._run_command(command, io)
       424│         self._running_command = None
       425│

  11  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/cleo/application.py:465 in _run_command
       463│
       464│         if error is not None:
     → 465│             raise error
       466│
       467│         return event.exit_code

  10  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/cleo/application.py:449 in _run_command
       447│
       448│             if event.command_should_run():
     → 449│                 exit_code = command.run(io)
       450│             else:
       451│                 exit_code = ConsoleCommandEvent.RETURN_CODE_DISABLED

   9  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/cleo/commands/base_command.py:119 in run
       117│         io.input.validate()
       118│
     → 119│         status_code = self.execute(io)
       120│
       121│         if status_code is None:

   8  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/cleo/commands/command.py:83 in execute
        81│
        82│         try:
     →  83│             return self.handle()
        84│         except KeyboardInterrupt:
        85│             return 1

   7  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/poetry_plugin_export/command.py:91 in handle
        89│         exporter.with_credentials(self.option("with-credentials"))
        90│         exporter.with_urls(not self.option("without-urls"))
     →  91│         exporter.export(fmt, self.poetry.file.parent, output or self.io)
        92│

   6  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/poetry_plugin_export/exporter.py:72 in export
        70│             raise ValueError(f"Invalid export format: {fmt}")
        71│
     →  72│         getattr(self, self.EXPORT_METHODS[fmt])(cwd, output)
        73│
        74│     def _export_requirements_txt(self, cwd: Path, output: IO | str) -> None:

   5  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/poetry_plugin_export/exporter.py:85 in _export_requirements_txt
        83│         )
        84│
     →  85│         for dependency_package in get_project_dependency_packages(
        86│             self._poetry.locker,
        87│             project_requires=root.all_requires,

   4  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/poetry_plugin_export/walker.py:95 in get_project_dependency_packages
        93│         selected.append(dependency)
        94│
     →  95│     for package, dependency in get_project_dependencies(
        96│         project_requires=selected,
        97│         locked_packages=repository.packages,

   3  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/poetry_plugin_export/walker.py:121 in get_project_dependencies
       119│         )
       120│
     → 121│     nested_dependencies = walk_dependencies(
       122│         dependencies=project_requires,
       123│         packages_by_name=packages_by_name,

   2  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/poetry_plugin_export/walker.py:138 in walk_dependencies
       136│     while dependencies:
       137│         requirement = dependencies.pop(0)
     → 138│         if (requirement, requirement.marker) in visited:
       139│             continue
       140│         visited.add((requirement, requirement.marker))

   1  ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/poetry/core/version/markers.py:591 in __hash__
       589│         h = hash("multi")
       590│         for m in self._markers:
     → 591│             h |= hash(m)
       592│
       593│         return h

  TypeError

  unhashable type: 'UnionConstraint'

  at ~/.pyenv/versions/3.10.3/envs/vision-3.10/lib/python3.10/site-packages/poetry/core/version/markers.py:357 in __hash__
      353│
      354│         return self._name == other.name and self._constraint == other.constraint
      355│
      356│     def __hash__(self) -> int:
    → 357│         return hash((self._name, self._constraint))
      358│
      359│     def __str__(self) -> str:
      360│         return f'{self._name} {self._operator} "{self._value}"'
      361│

presumably fixed by https://github.com/python-poetry/poetry-core/pull/466

Closing as there is no reproduction.


Team 7 Sprint 2 Submission

Changed backend to associate course with task.

did you guys pull latest update from my repo before you work on sprint2?


build with vs2017 C++   dll cmake generate fail

cmd:
cmake .. -G "Visual Studio 15 2017"  -DBUILD_SHARED_LIBS=ON
error tip:
CMake Error: install(EXPORT "gRPCTargets" ...) includes target "absl_bad_optional_access" which requires target "abseil_dll" that is not in any export set.
CMake Error: install(EXPORT "gRPCTargets" ...) includes target "absl_base" which requires target "abseil_dll" that is not in any export set.
CMake Error: install(EXPORT "gRPCTargets" ...) includes target "absl_int128" which requires target "abseil_dll" that is not in any export set.
CMake Error: install(EXPORT "gRPCTargets" ...) includes target "absl_log_severity" which requires target "abseil_dll" that is not in any export set.
CMake Error: install(EXPORT "gRPCTargets" ...) includes target "absl_raw_logging_internal" which requires target "abseil_dll" that is not in any export set.
CMake Error: install(EXPORT "gRPCTargets" ...) includes target "absl_spinlock_wait" which requires target "abseil_dll" that is not in any export set.
CMake Error: install(EXPORT "gRPCTargets" ...) includes target "absl_str_format_internal" which requires target "abseil_dll" that is not in any export set.
CMake Error: install(EXPORT "gRPCTargets" ...) includes target "absl_strings" which requires target "abseil_dll" that is not in any export set.
CMake Error: install(EXPORT "gRPCTargets" ...) includes target "absl_strings_internal" which requires target "abseil_dll" that is not in any export set.
CMake Error: install(EXPORT "gRPCTargets" ...) includes target "absl_throw_delegate" which requires target "abseil_dll" that is not in any export set.
CMake Error: install(EXPORT "gRPCTargets" ...) includes target "absl_time" which requires target "abseil_dll" that is not in any export set.
-- Generating done
CMake Generate step failed.  Build files cannot be regenerated correctly.

version :v1.33.2

any noe know how todo ?

help

@grtxm Can you give me an exact command list that you ran to see the error above? I couldn't reproduce the issue.

@grtxm Can you give me an exact command list that you ran to see the error above? I couldn't reproduce the issue.


How to ? Update(PUT) a field with default_factory=datetime.now ?

Hi,
Maybe someone could help...
I want to update a field "last_update" with "datetime.now" each time a PUT request is validate, and to store this key as Date type in mongodb
The only solution I've found is to add the key:value directly in the dict in my "_convert_for_update" function... But i'm not really satisfied with this solution. Maybe there is a better and proper way to do that ?
Here is my basic UserUpdate class:
class UserUpdate(BaseDocument):
    """
    User update model
    """
    name: str | None = None
    surname: str | None = None
    email: EmailStr | None = None
    nickname: str | None = None
    last_update: UTCDatetime = Field(default_factory=datetime.now)

and here my "_convert_for_update" function:
    async def _convert_for_update(self, data: UserUpdate) -> UpdateObject:
        result_dict = {**(await super()._convert_for_update(data))}
        result_dict['$set'].update({'last_update': data.last_update})
        return result_dict

Hi,
Thanks for giving the project a go!
I assume you use UserUpdate on the API as the payload type. In that case my first comment is that you shouldn't expose last_update there, because a client might actually decide to send this data and make your database invalid. I recommend an update model like this:
class UserUpdate(BaseDocument):
    """
    User update model.
    """
    name: str | None = None
    surname: str | None = None
    email: EmailStr | None = None
    nickname: str | None = None

Then you could implement _convert_for_update() like this:
    async def _convert_for_update(self, data: UserUpdate) -> UpdateObject:
        return {"$set": {**self._mongo_dump(data), "last_update": datetime.now(tz=timezone.utc)}}

No need to call super()._convert_for_update() as that's just a default implementation.

An alternative solution -- that maybe behaves better with static type checkers for example -- is to declare two update models, one without last_update (exposed on the API), and one with it (for backend use only), like this:
class AIPUserUpdate(BaseDocument):
    """
    User update model.
    """
    name: str | None = None
    surname: str | None = None
    email: EmailStr | None = None
    nickname: str | None = None

class UserUpdate(APIUserUpdate):
    last_update: UTCDatetime  # Important, no default here

    @classmethod
    def from_api_update(cls, data: APIUserUpdate) -> UserUpdate:  # requires from __future__ import annotations, or even better the Self type if you're on Python 3.11.
        return cls(**data.dict(), last_update=datetime.now(tz=timezone.utc))

Then you could either do the AIPUserUpdate to UserUpdate conversion outside the service, or inside the _convert_for_update() method like this:
async def _convert_for_update(self, data: APIUserUpdate) -> UpdateObject:
        return await super()._convert_for_update(UserUpdate.from_api_update(data))

If none of these options are sufficiently good, maybe it'd make sense to add an extra hook method to Service that returns a Pydantic model instance containing extra data that must be set in every update. (Actually, two methods, one for insert and one for update).
Let me know what you think.

thanks a lot !!
As you can see i'm kind of noobs in python...
You're first example make me realise that i was stuck with the default implementation and the second one is exactly what i'm trying to do...
Hope your work will be used by many people, it's great ;)

I admit I didn't have time to actually try the code from my comment, I mostly focused on the structure.
Could you maybe check the value UserUpdate.from_api_update() and the return value of await super()._convert_for_update(UserUpdate.from_api_update(data))? Do they seem correct?
I'll add a working example for this use-case to the docs when I have some time.

I understand and I am already very grateful for your interest in my concerns.
UserUpdate.from_api_update() :
name='string' surname='string'<EMAIL_ADDRESS>nickname='string' last_update=datetime.datetime(2023, 9, 13, 13, 57, 52, 313418, tzinfo=datetime.timezone.utc)
await super()._convert_for_update(UserUpdate.from_api_update(data)) :
{'$set': {'name': 'string', 'surname': 'string', 'email'<EMAIL_ADDRESS>'nickname': 'string', 'last_update': '2023-09-13T13:57:52.313418Z'}}
I don't want to say something stupid but to have a time Date in mongodb i think the result of await super()._convert_for_update(UserUpdate.from_api_update(data)) should be:
{'$set': {'name': 'string', 'surname': 'string', 'email'<EMAIL_ADDRESS>'nickname': 'string', 'last_update': datetime.datetime(2023, 9, 13, 14, 19, 38, 969798, tzinfo=datetime.timezone.utc)}}
In fact, this is exactly the problem that I have been trying to get around from the start... There is probably a solution with a serializer, but no matter how much I look at the fastAPI, pydantic and motorhead documentation, I don't see how to do...
 Actually, I think I need to fix Service._mongo_dump()... This just turned into a nice bug report. I'll do my best to fix this soon, then the code from my previous comment should work.

If you feel like giving the fix a try, feel free to submit a PR.
I think the bug is at line 814, where data.model_dump() gets mode="json" instead of mode="python".

ok, i need to go for now, but i'll try as soon as possible...

Fixed and published a new version of the package to PyPI (0.2309.0). Please update the package and try the code from my previous comment, it should be fine. I'll update the docs soon.

Arf too late !!
It's working, thanks a lot...

You're welcome. And thanks for the bug report!

One last note:
Instead of return cls(**data.dict(), last_update=datetime.now(tz=timezone.utc)), you should write return cls(**data.model_dump(), last_update=datetime.now(tz=timezone.utc)), because BaseModel.dict() is deprecated. :slightly_smiling_face:

j'avais déjà corrigé, but thanks ;)

There is another issue. If a field in UserUpdate is not set or None fastApi raise an error and ask for a valid value...
fastapi.exceptions.ResponseValidationError: 1 validation errors:
  {'type': 'string_type', 'loc': ('response', 'nickname'), 'msg': 'Input should be a valid string', 'input': None, 'url': 'https://errors.pydantic.dev/2.3/v/string_type'}

...still investigating

Based on the exception, nickname is None in the DB, but your response model expects a str.

You're right but the value is converted to null in db automatically with the same error even with a str in db...

Could you maybe paste your code here?

Idea: in _convert_for_update() you should probably use data.model_dump(exclude_unset=True).

this is what i'have done, my message was edited...
For a complete example of this special case, if you want to include this in your documentation, i've made some change to easily add a field last_update date in any Update* class ...

model.py

class UpdateLastUTCDatetime(BaseDocument):
    """
    User Last update  model
    """
    last_update_date: UTCDatetime = Field(default_factory=datetime.now)

class UserUpdate(UpdateLastUTCDatetime):
    """
    User update model
    """
    name: str | None = None
    surname: str | None = None
    email: EmailStr | None = None
    nickname: str | None = None

    @classmethod
    def add_user_update_date(cls, data: UpdateLastUTCDatetime) -> Self:
        return cls(**data.model_dump(exclude_none=True, exclude_defaults=False, mode="python"))

service.py

    async def _convert_for_update(self, data: UpdateLastUTCDatetime) -> UpdateObject | Sequence[UpdateObject]:
        return await super()._convert_for_update(UserUpdate.add_user_update_date(data))

I think exclude_none=True is incorrect (what if None is a valid value for a model property). mode="python" is the default, exclude_defaults=False is also the default. See my comment above, I think you must set exclude_unset=True (same as in the _mongo_dump()).

In this specific case exclude_unset=True does not work because pydantic default or factory_default are considered _unset...

With the example in my previous comment it should work, I didn't add a default (and added a comment) to last_update exatly for this reason.

OK, my example works with exclude_unset=True but i need a default value
Last comment edited.

I'm stupid.... Pydantic v2 can do what i want easily !
No need a parent or child class, no need "_convert_for_update()"....
Now we have the @computed_field and the @property decorator !!!
class UserUpdate(BaseDocument):
    """
    User update model
    """
    name: str | None = None
    surname: str | None = None
    email: EmailStr | None = None
    nickname: str | None = None

    @computed_field
    @property
    def last_update_date(self) -> UTCDatetime:
        return datetime.now(timezone.utc)

Now, last_update_date is not exposed... and that's all i need ^^


check if saved application exists

CI: No security warnings found

CI: No security warnings found

CI: No security warnings found

CI: No security warnings found


Advisories for Drupal contrib

Hello!
Just wondered if having advisories for Drupal contributed modules in here would be possible/wanted?
They generally do not have a CVE, and of course they would have to be maintained by someone. My thinking was to create a script that parses the advisories available, and programatically create PRs for the ones that were missing. This would help to keep it up to date as well, I could run the script periodically.
Thanks for this package btw, it is very useful!

Link to Drupal contrib advisories, for context: https://www.drupal.org/security/contrib

Issues without CVEs are ok.
Having Durpal contributed module issues is ok as well.
Having an automated process works for me (Typo3 has a script to automate the process as well -- https://github.com/TYPO3/darth/commit/4524eec445d4a785127232fea0324e8d4f5cf7f2), but please, don't create hundreds of PRs. One with everything is enough and then one PR from time to time to update things.

Good point, will do so!

@eiriksm Will you update the advisories here for https://www.drupal.org/SA-CORE-2019-003 and related modules? Thanks!
https://www.drupal.org/security

No problem, created one for core now.
The contribs, however, is what this issue is talking about, and will probably be part of one big initial PR in hopefully not too long (when I get time to finish it).

OK, so I prepared a huge dump of advisories for Drupal contrib.
However, they fail validation because of the following (example):
The yaml file looks like this:
link: 'https://www.drupal.org/sa-contrib-2017-091'
title: 'Configuration Update Manager - Moderately critical - Cross Site Request Forgery (CSRF) - SA-CONTRIB-2017-091'
branches:
    8.x-1.x: { time: '2019-02-21 22:21:04', versions: ['>=1.0.0', '<1.5.0'] }
reference: 'composer://drupal/config_update'

| drupal/config_update/sa-contrib-2017-091.yaml                | Invalid composer package (not found in repository https://packagist.org) |
|                                                              | Invalid branch name "8.x-1.x".                                           |

Now, I went through the code, and discovered the undocumented property "composer-repository" one could set in the yaml file. So if I change that to point to packages.drupal.org, like we use, that seems to take care of that. I will open a README PR if this is OK and supported.
Now for the other part. As you can see from for example here: http://cgit.drupalcode.org/config_update the branch is actually called 8.x-1.x. And this fails.
Since does not follow semver for contrib, the closest correct way (in this example) would be to have it like this (or similar):
link: 'https://www.drupal.org/sa-contrib-2017-091'
title: 'Configuration Update Manager - Moderately critical - Cross Site Request Forgery (CSRF) - SA-CONTRIB-2017-091'
branches:
    1.0.x: { time: '2019-02-21 22:21:04', versions: ['>=1.0.0', '<1.5.0'] }
    1.1.x: { time: '2019-02-21 22:21:04', versions: ['>=1.0.0', '<1.5.0'] }
    1.2.x: { time: '2019-02-21 22:21:04', versions: ['>=1.0.0', '<1.5.0'] }
    1.3.x: { time: '2019-02-21 22:21:04', versions: ['>=1.0.0', '<1.5.0'] }
    1.4.x: { time: '2019-02-21 22:21:04', versions: ['>=1.0.0', '<1.5.0'] }
    1.5.x: { time: '2019-02-21 22:21:04', versions: ['>=1.0.0', '<1.5.0'] }
composer-repository: 'https://packages.drupal.org/8'
reference: 'composer://drupal/config_update'

This makes it validate, and all is good. Is this the way to approach it for now?

for tagged releases, what is important is the version range, not the branch name anyway (and so you don't need to put all branches with the full range in your example, especially if older branches don't contain the fix at all)

OK, fair enough. But the problem here is that I can't even put the real branch name in there. So in this example, the branch is called 8.x-1.x and it is the only branch. But I can't put that as branch, since that does not validate. Should I put one branch in there, and call it 1.5.x then? Or call it 1.x or 8.x?

I suggest naming 1.5.x, as that matches the version range

this got reverted, because the drupal-contrib packages broke the usage of this advisory DB due to the fact that the same package name + version can appear in both the Drupal 7 and Drupal 8 repositories, while they represent the same package release as far as composer and its tooling are used.

Makes sense. Just another reason we should try to move to semantic versioning in Drupal land ;)


Does not install on Ubuntu linux 24.04 (with workaround)

Hi,
I love your tool here.
When I tried following your instructions, I ran into a dependency problem.
To start with, apt install ./filename usually works on Ubuntu to install .debs.
$ sudo apt install ./october_1.10.0_amd64.deb
Executing sudo -- bash -x -v -c "apt" 'install' './october_1.10.0_amd64.deb'
[sudo] password for klfjoat:
"apt" 'install' './october_1.10.0_amd64.deb'
+ apt install ./october_1.10.0_amd64.deb
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Note, selecting 'october' instead of './october_1.10.0_amd64.deb'
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 october : Depends: libwebkit2gtk-4.0-dev but it is not installable
E: Unable to correct problems, you have held broken packages.
100 $

Okay, dependency problem. So I used dpkg -i in case it was a soft dependency.
$ sudo dpkg -i october_1.10.0_amd64.deb
Executing sudo -- bash -x -v -c "dpkg" '-i' 'october_1.10.0_amd64.deb'
"dpkg" '-i' 'october_1.10.0_amd64.deb'
+ dpkg -i october_1.10.0_amd64.deb
Selecting previously unselected package october.
(Reading database ... 381473 files and directories currently installed.)
Preparing to unpack october_1.10.0_amd64.deb ...
Unpacking october (1.10.0) ...
dpkg: dependency problems prevent configuration of october:
 october depends on libgtk-3-dev; however:
  Package libgtk-3-dev is not installed.
 october depends on libwebkit2gtk-4.0-dev; however:
  Package libwebkit2gtk-4.0-dev is not installed.

dpkg: error processing package october (--install):
 dependency problems - leaving unconfigured
Processing triggers for desktop-file-utils (0.27-2build1) ...
Processing triggers for gnome-menus (3.36.0-1.1ubuntu3) ...
Processing triggers for hicolor-icon-theme (0.17-2) ...
Errors were encountered while processing:
 october
1 $

So, that didn't work. Unable to find the dependencies. So I checked and sure enough, hard dependencies on specific versions.
$ dpkg --info ./october_1.10.0_amd64.deb
 new Debian package, version 2.0.
 size 5332528 bytes: control archive=311 bytes.
     278 bytes,     9 lines      control
 Package: october
 Version: 1.10.0
 Section: base
 Priority: optional
 Architecture: amd64
 Depends: libgtk-3-dev, libwebkit2gtk-4.0-dev
 Maintainer: Marcus Crane<EMAIL_ADDRESS> Homepage: https://october.utf9k.net
 Description: A tool for syncing your Kobo highlights with Readwise
$

So I typed this in  and tabbed it out to get bash-completion to tell me what versions of libwebkit2 are available on Ubuntu 24.04.
$ apt show libwebkit2gtk-4.
libwebkit2gtk-4.0-37   libwebkit2gtk-4.0-doc  libwebkit2gtk-4.1-0    libwebkit2gtk-4.1-dev
$

FIX ABORTED INSTALL
So I first removed the aborted install...
$ sudo apt --fix-broken install
Executing sudo -- bash -x -v -c "apt" '--fix-broken' 'install'
"apt" '--fix-broken' 'install'
+ apt --fix-broken install
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Correcting dependencies... Done
The following packages will be REMOVED:
  october
0 upgraded, 0 newly installed, 1 to remove and 14 not upgraded.
1 not fully installed or removed.
After this operation, 0 B of additional disk space will be used.
Do you want to continue? [Y/n]
(Reading database ... 381480 files and directories currently installed.)
Removing october (1.10.0) ...
dpkg: warning: while removing october, directory '/usr/local/bin' not empty so not removed
Processing triggers for hicolor-icon-theme (0.17-2) ...
Processing triggers for gnome-menus (3.36.0-1.1ubuntu3) ...
Processing triggers for desktop-file-utils (0.27-2build1) ...
needrestart is being skipped since dpkg has failed

WORKAROUND INSTALL
Then I installed v4.1 of the dependency and installed October, ignoring dependencies using --force-depends...
$ sudo apt install libwebkit2gtk-4.1-dev
Executing sudo -- bash -x -v -c "apt" 'install' 'libwebkit2gtk-4.1-dev'
"apt" 'install' 'libwebkit2gtk-4.1-dev'
+ apt install libwebkit2gtk-4.1-dev
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following additional packages will be installed:
  libatk-bridge2.0-dev libatk1.0-dev libatspi2.0-dev libcairo2-dev libdatrie-dev libegl1-mesa-dev
  libepoxy-dev libgdk-pixbuf-2.0-dev libglvnd-core-dev libglvnd-dev libgtk-3-dev
  libjavascriptcoregtk-4.1-dev libnghttp2-dev libopengl-dev libpango1.0-dev libpixman-1-dev
  libpsl-dev libsoup-3.0-dev libsqlite3-dev libsysprof-capture-4-dev libthai-dev libxcomposite-dev
  libxdamage-dev libxft-dev libxtst-dev pango1.0-tools
Suggested packages:
  libcairo2-doc libdatrie-doc libgtk-3-doc libnghttp2-doc libpango1.0-doc libsoup-3.0-doc
  sqlite3-doc libthai-doc graphicsmagick
The following NEW packages will be installed:
  libatk-bridge2.0-dev libatk1.0-dev libatspi2.0-dev libcairo2-dev libdatrie-dev libegl1-mesa-dev
  libepoxy-dev libgdk-pixbuf-2.0-dev libglvnd-core-dev libglvnd-dev libgtk-3-dev
  libjavascriptcoregtk-4.1-dev libnghttp2-dev libopengl-dev libpango1.0-dev libpixman-1-dev
  libpsl-dev libsoup-3.0-dev libsqlite3-dev libsysprof-capture-4-dev libthai-dev
  libwebkit2gtk-4.1-dev libxcomposite-dev libxdamage-dev libxft-dev libxtst-dev pango1.0-tools
0 upgraded, 27 newly installed, 0 to remove and 14 not upgraded.
Need to get 3,770 kB of archives.
After this operation, 34.7 MB of additional disk space will be used.
Do you want to continue? [Y/n]
...blah, blah, blah
Setting up libgtk-3-dev:amd64 (3.24.41-4ubuntu1.1) ...
Setting up libwebkit2gtk-4.1-dev:amd64 (2.44.3-0ubuntu<IP_ADDRESS>) ...
Processing triggers for man-db (2.12.0-4build2) ...
Scanning processes...
Scanning processor microcode...
Scanning linux images...

Running kernel seems to be up-to-date.

The processor microcode seems to be up-to-date.

No services need to be restarted.

No containers need to be restarted.

No user sessions are running outdated binaries.

No VM guests are running outdated hypervisor (qemu) binaries on this host.

$ sudo dpkg -i --force-depends october_1.10.0_amd64.deb
Executing sudo -- bash -x -v -c "dpkg" '-i' '--force-depends' 'october_1.10.0_amd64.deb'
"dpkg" '-i' '--force-depends' 'october_1.10.0_amd64.deb'
+ dpkg -i --force-depends october_1.10.0_amd64.deb
Selecting previously unselected package october.
(Reading database ... 382705 files and directories currently installed.)
Preparing to unpack october_1.10.0_amd64.deb ...
Unpacking october (1.10.0) ...
dpkg: october: dependency problems, but configuring anyway as you requested:
 october depends on libwebkit2gtk-4.0-dev; however:
  Package libwebkit2gtk-4.0-dev is not installed.

Setting up october (1.10.0) ...
Processing triggers for desktop-file-utils (0.27-2build1) ...
Processing triggers for gnome-menus (3.36.0-1.1ubuntu3) ...
Processing triggers for hicolor-icon-theme (0.17-2) ...

SUGGESTION
I'm not sure if Wallis requires -dev packages to just run an application--that's unusual, but not unheard of. As a longtime linux admin (admittedly, not a programmer), I would suggest three things (pick and choose between them).

Make sure you need the -dev- packages and not just the main package. My host has libwebkit2gtk-4.0-37 available, but not a 4.0-dev available.
See if you can create a more liberal dependency specification. My host has both libwebkit2gtk-4.0-37 & libwebkit2gtk-4.1-0 available. Maybe a spec like Depends: libwebkit2gtk-4.0|libwebkit2gtk-4.1? (ref1, ref2)
libwebkit2gtk-4.1, at the very least, itself depends on libgtk-3 in Debian.  So you might be able to skip that dependency.

Hey @KlfJoat,
Ah, thanks for that great writeup! You're the first person I'm aware of that has used the Linux version at all. Personally, I'm not running any Linux installs at the moment so I wasn't aware of this.
I probably don't need the -dev versions, I just happened to install those because they worked and I hadn't thought too much about the pinned libwebkit2gtk versions breaking as new OS releases roll out.
It probably doesn't even need to be pinned anyway, just any version of libwebkit2gtk should do the job.
I haven't had much time to look at October lately but I'll spin up my VM sometime and have a look at this

Hi,
Same issue, however workaround as given does not work. Get the following error when running: october: error while loading shared libraries: libwebkit2gtk-4.0.so.37: cannot open shared object file: No such file or directory
I was able to run it by following the process referred to here: https://github.com/bambulab/BambuStudio/issues/3973#issuecomment-2085476683 (you have to add those statements to the sources, apt update, apt --fix-broken install (or if you don't have a broken october install you can just install it at that point), then remove those entries from the sources list again to make sure terrible things don't happen). As the original reporter mentioned I think it could probably solved relatively easily with some more liberal linking.
Anyway, apart from that small issue, it works great. Thanks for the software, @marcus-crane.

@reality Adding an old repository like mentioned in that comment can mess up your dpkg database beyond all reasonable attempts to fix it. I would highly recommend against that being the first thing that people try.
Installing the new version of the dependency, then forcing only October to ignore its dependency list, is the best option.

We've limited the scope of what's non-standard to just the October deb. There's no way for something else besides October to be affected by the workaround I proposed. On the other hand, mixing release repos can have strange and sometimes devastating consequences.
Because these are header files (-dev), there is no difference in compatibility where we'd need 4.0-dev-37 exactly. So we don't gain anything by mixing release repos.

sure, but like i said in my comment, your workaround doesn't work for me - that is actually why i sought another solution.

Heya,
No promises as always since I can't predict the future but I'll see if I can make the linking for libwebkit2gtk a bit less strict this weekend.
As far as Wails (the underlying framework), it seems that the approach some other projects have taken is to just distribute two copies of their projects: one for 4.0 and another for 4.1 which seems kind of wonky.
Wails itself seems to mostly push this issue to the packagers (which I suppose is me in this case) and is looking to lean on AppImage and the like.
I guess I'm learning the hard way why Snap/Flatpak/AppImage are a thing. Personally I don't really like any of them since they always have something wonky about them in my (fairly limited) experience.

Heya,
I've had a look around and I think I understand the constraints a lot better now. That said, I haven't had to fiddle with static/dynamic linking stuff in Linux. Given that, I'm building out a mental model of what's going on at the same time as trying to understand a possible fix so you'll have to let me know if I'm misinterpreting anything here.
As a tl;dr, it seems the only real options here are:

Create separate deb packages for webkit2gtk 4.0 and 4.1 which is annoying but I don't really see any other way around it
Hide all this complexity by setting up an apt repository so the "correct" version can be pulled based on whether you're on a newer or older version of Ubuntu (Debian and other spinoffs might need some consideration)

The rest of this post is just elaborating my understanding of the problem in detail for any interested readers and/or other Wails devs who have probably run into this problem. Feel free to skip the rest if you're not particularly interested.
So, there's a couple issues here tangled together as far as I can tell:

October (by way of Wails) is dynamically linked vs statically linked
Wails pinned dependency on specific versions of webkit2gtk (4.0/4.1) vs a loose dependency (ie webkit2gtk >= 2.0)
Out of date Depends for the control file used to build the deb file

Dynamic vs static linking
If I compile a fresh build of October locally, I can use ldd on the binary to see which libraries it is dynamically linked to, meaning it'll try to pull in these dependencies from my file system as opposed to them being baked into the binary itself.

As you can see, some of these links are done at the version level so for example, if you had libsoup-2.4 installed, presumably October would crash as it wouldn't be able to resolve that link.[^1]
As a workaround, you could symlink /usr/lib/libsoup-3.0.so.0 to /usr/lib/libsoup-2.4.so.0 and this may work by chance but there's also the likelihood that the API surfaced by that dependency is completely different between 2.4 and 3.0. Given it's a major version, semver would suggest that's more likely than not.
Now, even if the APIs between those two dependency versions were identical (or changes were only adding new functionality, not changing anything existing), there's no guarantee that the ABI for that library hasn't changed. I can't really speak to ABI stuff since I've only been vaguely aware of the term without really reading about it until now.
With all that said, actually trying to produce a fully statically linked application for something that depends on GTK doesn't actually seem to be supported. Even if I were to attempt it, I'm not actually sure that it would functionally work.
It seems that the conventional solution here is to package up everything using Flatpak/AppImage/Snap which solves the dependency issue by stuffing the final build in a container. I'd probably provide those versions for convenience (and the currently unreleased v3 of Wails seems to make this easier than ever) but they're a bit of an apples to oranges comparison for people who like "installing" apps via deb.
Wails hard pinning vs loosening up dependencies
Wails currently supports building against webkit2gtk 4.0 vs 4.1 by way of using build tags.
You can see how this is structured here by way of CGO declarations building certain files based on the installed version of libwebkit2gtk at build time.
From the referenced PR, you can see that there are actually different implementations of the asset server based on what version of libwebkit2gtk exists with functionality being slightly different as a result.
While I'm sure unpinning libwebkit2gtk would be a bad idea purely for the API/ABI reasons mentioned above, I think even if you did that in theory, the resulting compiled binary would still be statically linked to the specific version installed at build time, so it wouldn't actually resolve anything.
Out of date depends in deb
This one I can actually influence and it should be updated to either assert a recent version of webkit2gtk (ie; 4.0||4.1) or match whatever build tag is used.
Actually removing it or modifying it won't change the reality of the application being dynamically linked to a specific version but it'll still assert for the user that they have webkit2gtk installed since October would just crash if they didn't have it installed (rather than prompting them to install it like Windows 10 with webview2 for example)

Another thing mentioned was the requirement for -dev. It seems to be mentioned here and there about it being required although I can't really speak to that. It might be that the end user doesn't specifically need -dev but it's still required at build time in order to do dynamic linking at compile time. Most of that is all abstracted away as a developer honestly.
Anyway, for now, I'll just generate a second deb package with 4.0 vs 4.1 support as a starting point and then potentially iterate towards an apt repository as well as flatpak/snap/appimage support.
I don't think it'd ever be possible to have a single binary/package that supports all webkit2gtk versions (due to dynamic linking) but I do wonder how other non-Wails projects solve this stuff as far as webkit2gtk dependencies.
[^1]: I'm not actually sure what the crash behaviour is for dynamic links ie; does it hard crash or can it run but malfunction? It'd be easy to test, I just haven't done it at the time of writing.

Anyway, just to be a bit more explicit, I'm gonna go for a walk after hurting my brain parsing through all the above but I'll try and generate some builds later today + add some docs around which versions to use.
It'll work as a stop gap to unblock support for newer Ubuntu versions but it does seem a bit like one of those issues where you just have to pick the least worst choice since they all come with tradeoffs

I've got some bits of the release pipeline to fix up still but I've generated two versions of the Linux deb package available in this prerelease: https://github.com/marcus-crane/october/releases/tag/v1.10.1-beta2
The non-webkit2gtk4.0 version should work for you.
I'm not entirely sold on the naming scheme for the releases but it'll do for now


Remove apiextensions/v1beta1 reference

Re: https://github.com/stolostron/backlog/issues/23199, the only deprecated K8s API listed here that is used/referenced in the code is
"k8s.io/apiextensions-apiserver/pkg/apis/apiextensions/v1beta1". This API is only referenced to add it to the scheme and is not actually used so remove it.

/approve

/approve

/lgtm


[BUG] horizontal grid lines can not be disabled

Expected Behavior
setting chart.grid(False) should remove both vertical and horizontal grid lines. but as of now only vertical grid lines can be removed,
Current Behaviour
horizontal grid lines still persist
Reproducible Example
set  chart.grid(False) and open any csv

Environment
- OS:Linux
- Library:  lightweight_charts==1.0.19

Hey,
chart.grid(False, False).
Louis


Bugs when read from compatible proto definition

proto definitions:
syntax = "proto3";

package scalapb.spark.schema.bug;

message Write {
  repeated RepeatedNestedWrite nested_field = 6;
  string additional_field = 14;
}

message RepeatedNestedWrite {
  RepeatedOmitWrite omit_for_read = 2;
  string field_one = 7;
  string field_two = 8;
  Nested persisted = 9;
}

message RepeatedOmitWrite {
  string field_one = 5;
  string field_two = 6;
}

message Nested {
  string field_one = 5;
}

message Read {
  repeated RepeatedNestedRead nested_field = 6;
  string additional_field = 14;
}

message RepeatedNestedRead {
  string field_one = 7;
  string field_two = 8;
  Nested persisted = 9;
}

Steps to reproduce: 1) write some data with the Write class 2) read the data with Read, and it results in Spark exceptions. java.lang.NegativeArraySizeException.
a PR to fix this is on the way.

PR opened: https://github.com/scalapb/sparksql-scalapb/pull/314

@thesamet Can you do a release? Our projects need this bugfix; otherwise, we need to fork this repo and build a custom version.

Sure, I've just kicked off a release (v1.0.3). It should be available on maven shortly. https://github.com/scalapb/sparksql-scalapb/actions/runs/4663535643/jobs/8254944857

@thesamet Thank you so much!


Spring Authorization server - limit a client to a specific resource server

Expected Behavior

@Override
public void configure(ClientDetailsServiceConfigurer clients) throws Exception {
ClientDetailsServiceBuilder.ClientBuilder clientBuilder = clients
.inMemory()
.withClient("client1")
.resourceIds("resourceServer1")
...
Context

How to configure a resource id for a resource server
Client management How to store the resource ids authorized by the current client id(The old authorization management had this field)

@zxiaozhou Thanks for getting in touch, but it feels like this is a question that would be better suited to Stack Overflow. We prefer to use GitHub issues only for bugs and enhancements. Feel free to update this issue with a link to the re-posted question (so that other people can find it).
Please see OAuth2TokenCustomizer as it allows you to add custom claims in the Jwt, e.g. resource_id.
You can store the resource_id's for each client in RegisteredClient.clientSettings.

Related gh-279


"'NoneType' object has no attribute 'attrs'" error when activating some books

I have from time to time this error :
Today's free Packt ebook grabbing has failed with exception: 'NoneType' object has no attribute 'attrs'!

Logs :
[INFO] - Creating session...
[INFO] - Session created, logged in successfully!
[INFO] - Start grabbing eBook...
[INFO] - Captcha detected. Trying to solve it using anti-captcha.com.
[INFO] - TaskId created: 67762126
[INFO] - Waiting for completion of the task: 67762126...
[SUCCESS] - Solution found for task: 67762126
[SUCCESS] - eBook: '****************' has been successfully grabbed!
[INFO] - Retrieving complete information for '****************
[ERROR] - Exception occurred 'NoneType' object has no attribute 'attrs'
[INFO] - Sending email from **************** to **************** ...
[INFO] - Email to **************** has been succesfully sent

In the packt website > account > My Ebooks >the corresponding book seems to be correctly grabbed this day.

Thanks for submitting this error! Personally I don't use -l parameter so I've never seen this (the script lacks testing though).
OK, I see - it succeeded in grabbing the ebook, but failed on fetching ebook's data. It couldn't find URL for downloading code files, because there are none, so there is no <a> inside button (which is disabled). Did it happen with "Mastering Windows PowerShell Scripting - Second Edition" today? Did other books with which the script failed in this way also didn't have code files?

I'm only using it since ten days. It has failed two times :

18/11/2018 "Mastering Windows PowerShell Scripting"
08/11/2018 "Understanding software"
Indeed it seems both of these books don't have any code attached to them.

OK, the problem is that script tries to find code files URL even if it doesn't exist. Do you want to make a pull request or should I?

https://github.com/igbt6/Packt-Publishing-Free-Learning/pull/117
Here is a fix for this issue.

Fixed at #117


CDC scan speed metric not accurate

What did you do?

Change TiKV configuration

cdc.incremental-fetch-speed-limit= 256MiB (default 512MiB)
cdc.incremental-scan-speed-limit = 64MiB (default 128MiB)

Create CDC changefeed
Pause the changefeed
Run workload for a long time e.g. 24H
Resume changefeed

What did you expect to see?
CDC metrcis should be accurate.
What did you see instead?
The metrics CDC scan speed below actually corresponding to cdc.incremental-fetch-speed-limit.

Versions of the cluster
bash-5.1# /cdc version
Release Version: v6.5.3-20231116-255d810
Git Commit Hash: 255d8104c8b9b4f8af191ee69d301ced723ccc3d
Git Branch: heads/refs/tags/v6.5.3-20231116-255d810
UTC Build Time: 2023-11-16 06:35:28
Go Version: go version go1.19.12 linux/amd64
Failpoint Build: false

/severity moderate

@hicqu could please take look at this issue? Thank you~!


Update to nan 2 for Node.js 4.0.0 compatibility.

Adding to the list: https://github.com/nodejs/node/issues/2798.

See also #19, #22.


Arxiv Code and Data Release

Arxiv相关的代码、demo和数据将在一到两周内release
The code, demos, and data related to Arxiv will be released within one to two weeks.

hello Geniuses! thanks for your amazing works!
i notice that you guys relese the 54k-dataset. but i didnt found the way to format the raw data for training.
is there a chance to know how your impressive work is carried out in preparing the dataset?

When you say raw data
you mean the raw novel text data, or the text data we finally ask language model to learn
for the latter see a dataset we've uploaded https://huggingface.co/datasets/silk-road/Chat_Suzumiya_Fusion in this link
for raw data extracting most of those code are at kyon_generator folder and we may clean it later
for novel data extracting see the notebook here
https://github.com/LC1332/Prophet-Andrew-Ng/blob/main/langchain/李鲁鲁学LangChain_25_Kor信息抽取.ipynb
the project are still in building and I will release a tutorial later, to figure out how to extract dialogues from a novel


Cache "numer of" variables to reduce API calls

These changes look to cache the "NumberOf" properties for use during immutable loops, thus reducing API called behind the "get" accessors. There is also a change to nullify the internal curve collection caches after surface extensions to force for re-evaluation on the next "get".

I noticed that there were some odd white spacing going on. Tabs instead of spaces made things look odd in the review. I replaced tabs with 4 spaces and that tidied it up.


Make Span::initial() a const fn

In Arret nearly every intermediate data structure contains a Span so our generated code can be mapped back to source location. However, they're rarely used until we need to report a diagnostic or generate debugging information.
This led to a common pattern in unit tests where we use a dummy span to test intermediate transformations where we aren't starting from actual Arret source. This used to be a const called EMPTY_SPAN which can be used to build other const data structures used for testing.
In etaoins/arret#160 we needed to switch to an empty_span() function because there is no longer a const constructor for Span.
We can't make Span::new const yet because const functions are not powerful enough. However, Span::initial is perfect for this use case.

Thanks!


Enable multiple tokens to be deployed for the same asset

Description/Reasoning

currently, only a single token contract can be deployed for a given asset.
if there is a error during the deployment process, this leads to a problem and needs to be patched via a consensus/contracts upgrade.
we want to allow deployment of multiple contracts per asset to avoid this [and just to support more flexibility in the future].

do we really want multiple token contracts or do we want the capability to overwrite the existing one, i.e. only one contract is ever connected to the gateway?

multiple contracts per asset.
we should figure out what the "key" would be here. contract assetName probably will work (axelarUST, axelarUST2, etc)
overwriting is pretty dangerous; if there are funds that are maintained already by the contract, users could lose them; to solve this, we'd, at least, need to put some governance processes around those overwrite functions, etc. I don't want to go in that direction.


Multiple segment TDFs don't work

When building a TDF we currently add a new payload entry for each segment.
This works as long as TDFs don't span multiple segments but will break with any payload larger than a single segment.

fixed by #65


How to use OR in blade

hi, how to use or in blade?  for example if user is administrator or user is manager ?
@ifUserIs('administrator') or ifUserIs('manager')

Are you change that in source?

v0.2 is ready. You can use OR operator now.

Thanks you very much :)

please update package on composer. i can not update to v.02

composer updates tags automatically so change your composer.json:
"phpzen/laravel-rbac": "^0.2"

and run composer update

Oh your are right. i'm sorry i forgot it.


Its up and running.
Here is the successful run - http://cna-storage-jenkins.eng.vmware.com/job/k8s-release-dev-ci-latest/3/
As mentioned at https://github.com/kubernetes/kubernetes/issues/52884#issuecomment-331647423 , installed  binfmt-support and qemu-user-static packages on the CI host to unblock building hyperkube image.


Can't install on Windows

normal windows 10, normal installed python latest.
I try to build, It can't find python??  I have the default setup, nothing weird.  which command returns python path.
checkPythonLauncher seems pretty bad, I would look there.
f:\Github\electron-store\node_modules\runas>if not defined npm_config_node_gyp (node "c:\Program Files\nodejs\node_modules\npm\bin\node-gyp-bin\....\node_modules\node-gyp\bin\node-gyp.js" rebuild )  else (node "" rebuild )
gyp WARN download NVM_NODEJS_ORG_MIRROR is deprecated and will be removed in node-gyp v4, please use NODEJS_ORG_MIRROR
gyp ERR! configure error
gyp ERR! stack Error: Can't find Python executable "c:\Users\Steve\AppData\Local\Programs\Python\Python36-32\python.EXE", you can set the PYTHON env variable.
gyp ERR! stack     at PythonFinder.failNoPython (c:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\lib\configure.js:454:19)
gyp ERR! stack     at PythonFinder. (c:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\lib\configure.js:480:16)
gyp ERR! stack     at c:\Program Files\nodejs\node_modules\npm\node_modules\graceful-fs\polyfills.js:284:29
gyp ERR! stack     at FSReqWrap.oncomplete (fs.js:111:15)
gyp ERR!   The code looks buggy.

Exact steps please?  People set PYTHON all the time so odds are it's something on your end.
If you invoke node-gyp through npm, do npm config set python \path\to\python2.7.

Also you need python 2 -- python 3 will not work.

After resolve this, there are tons of issues remaining...

No follow-up from OP, closing.


Pyrealsense2 for Raspberry Pi

|---------------------------------|------------------------------------------- |
| Camera Model                       | { T265 } |
| Operating System & Version |  Description:	Ubuntu MATE 22.04.3 |
| Kernel Version (Linux Only)    |  5.15.0-1044-raspi |
| Platform                                 | Raspberry Pi 4  |
| Language                            |  python  |
Hi there,
I'm using the T265 with Raspberry pi 4 "4GB' and using python to interact with Ardupilot.
since Pip install pyrealsense2 isn't working for RPI, so building the librealsense is the way to go, I used 'cmake ../ -DFORCE_RSUSB_BACKEND=true -DBUILD_PYTHON_BINDINGS=bool:true -DCMAKE_BUILD_TYPE=release -DBUILD_EXAMPLES=true -DBUILD_GRAPHICAL_EXAMPLES=true -DPYTHON_EXECUTABLE=$(which python3)' and it was successful but when trying to run 'import pyrealsense2', i get the error 'ModuleNotFoundError: No module named 'pyrealsense2'', even thou I used (-DBUILD_PYTHON_BINDINGS=bool:true, -DPYTHON_EXECUTABLE=$(which python3)') it is not binded.
Also, I used this (cmake .. -DBUILD_PYTHON_BINDINGS=bool:true -DPYTHON_EXECUTABLE=$(which python3))
, I also tried flashing the [apsync-rpi-ubuntu-t265-latest.img.xz] but the raspberry doesn't boot up.
please let me know if I am missing something or I am forgetting something.

It looks like Pyrealsense2 isn't built for ARM.
Check https://github.com/IntelRealSense/librealsense/issues/11506#issuecomment-1599168850


Using emojis as prefix causes labels to be removed and added continuously

We're seemingly hitting an issue where using an emoji i.e. 📦 as the prefix causes the same labels to be removed and added on each sync of our PRs. For example:

Sample config:

That's no fun @craigthompsonhive. I love emojis. So sad. I'll take a look into this issue but it probably won't be until next week. Feel free to submit a PR if you are interested in triaging and fixing before then.


[Go] Remove go/

Describe the enhancement requested
Blockers:

#43872
#43873
#43874
#43875
#43876
#43878

Component(s)
Go

@kou now that the arrow-go repository is "ready" for development there, I plan to start working on these tasks to prepare the repo for 18.0.0 so we don't release go. Let me know if you think there's something that has to be done before.

+1

Issue resolved by pull request 44293
https://github.com/apache/arrow/pull/44293


[TUBEMQ-485]Add the batch setting API of consume group offset

Codecov Report

Merging #377 (547c4a0) into master (8d1093a) will decrease coverage by 0.02%.
The diff coverage is 0.00%.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8d1093a...547c4a0. Read the comment docs.

Codecov Report

Merging #377 (547c4a0) into master (8d1093a) will decrease coverage by 0.02%.
The diff coverage is 0.00%.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8d1093a...547c4a0. Read the comment docs.


Distilbert texts_from_folder

This following seems to be running fine. Running on ktrain 0.25.0.
(x_train, y_train), (x_test, y_test), preproc = text.texts_from_folder(
            data_dir, maxlen=500, preprocess_mode='bert',
            train_test_names=['train', 'test'],
            classes=['pos', 'neg'])

However, switching to distilbert doesn't:
(x_train, y_train), (x_test, y_test), preproc = text.texts_from_folder(
            data_dir, maxlen=500, preprocess_mode='distilbert',
            train_test_names=['train', 'test'],
            classes=['pos', 'neg'])

Which causes this error:
detected encoding: utf-8
preprocessing train...
language: en
train sequence lengths:
        mean : 303
        95percentile : 557
        99percentile : 782
Traceback (most recent call last):
  File "NLP_run_training.py", line 56, in <module>
    nlptrain = NLPtrain(args.pathology, args.model_version, run_splits=args.run_splits)
  File "NLP_run_training.py", line 40, in __init__
    classes=['pos', 'neg'])
  File "/opt/miniconda3/envs/env_nlp/lib/python3.6/site-packages/ktrain/text/data.py", line 115, in texts_from_folder
    trn = preproc.preprocess_train(x_train, y_train, verbose=verbose)
  File "/opt/miniconda3/envs/env_nlp/lib/python3.6/site-packages/ktrain/text/preprocessor.py", line 918, in preprocess_train
    verbose=verbose)
  File "/opt/miniconda3/envs/env_nlp/lib/python3.6/site-packages/ktrain/text/preprocessor.py", line 329, in hf_convert_examples
    pb = progress_bar(texts, parent=mb)
  File "/opt/miniconda3/envs/env_nlp/lib/python3.6/site-packages/fastprogress/fastprogress.py", line 226, in __init__
    super().__init__(gen, total, display, leave, parent, master)
  File "/opt/miniconda3/envs/env_nlp/lib/python3.6/site-packages/fastprogress/fastprogress.py", line 24, in __init__
    parent.add_child(self)
  File "/opt/miniconda3/envs/env_nlp/lib/python3.6/site-packages/fastprogress/fastprogress.py", line 264, in add_child
    self.child.prefix = f'Epoch {self.main_bar.last_v+1}/{self.main_bar.total} :'
TypeError: unsupported operand type(s) for +: 'NoneType' and 'int'

Hello:
First, I need to point out that tuples of NumPy arrays are NOT returned when selecting 'distilbert' as the model.  When you do text_classifier('bert', ..., the texts_from_folder function returns a tuple of NumPy arrays.  However, when you do text_classifier('distilbert' ..., the texts_from_folder function returns TransformerDataset objects.  As shown in the tutorials and example notebooks, you need to change the call to this for things to work:
trn, val, preproc = text.texts_from_folder(
            data_dir, maxlen=500, preprocess_mode='distilbert',
            train_test_names=['train', 'test'],
            classes=['pos', 'neg'])

However, I think the error you're getting is different and occurring even before this issue above even happens.
Based on your setting of train_test_names and classes, your data_dir folder should look like this:
    ├── datadir
    │   ├── train
    │   │   ├── pos       # folder containing documents of class pos
    │   │   ├── neg       # folder containing documents of class neg
    │   └── test
    │       ├── pos       # folder containing documents of class pos
    │       ├── neg       # folder containing documents of class neg

Are you sure your data_dir folder is structured like this when trying to use distilbert?    I don't see a reason why 'distilbert' would throw that error and 'bert' would not, as the code that crawls the folder to collect documents is exactly the same.
What happens when you run this?  What does x_train, y_train, x_test, and y_test contain?
import os.path
from sklearn.datasets import load_files
train_b = load_files(os.path.join(data_dir, train_str), shuffle=True, categories=classes)
test_str = train_test_names[1]
test_b = load_files(os.path.join(data_dir,  test_str), shuffle=False, categories=classes)
x_train = train_b.data
y_train = train_b.target
x_test = test_b.data
y_test = test_b.target

Thanks for your prompt response and for pointing out the issue about the call. As you predicted, the error seems to arise before this.
I have been using the BERT setting for a long time with no issues, so I think the data is structured properly, like the way you have outlined above. When I run your code, I get the following:
x_train and x_test are both lists of strings from my text files.
y_train and y_test are numpy arrays containing 0 and 1.
x_train/y_train and x_test/y_test pairs are equal in length.

I  ran an example myself and everything in texts_from_folder works correctly when selecting distilbert.  So, I don't think this is a bug in the ktrain code.
I think the problem is that you're using a very old version of fastprogress that includes this bug.   If you upgrade to the latest version of fastprogress that includes a fix for this problem, everything should work.
For good measure, you may want to create a new virtual environment and install ktrain and its dependencies from scratch.

I got it to run through with no issue after the fastprogress update. Thanks so much! Great work on this repo.


Add owin.RequestUser

The key owin.RequestUser was voted on and accepted as part of https://github.com/owin/owin/issues/9, and has been added to the spec under Section 3.2.1 Request Data.
This PR adds the key to the environment and feature collection :sparkles:
The property will set both server.User and owin.RequestUser, as well as fall back from owin.RequestUser to server.User on retrieval, for interoperability reasons.

Hi @khellang, I'm your friendly neighborhood .NET Foundation Pull Request Bot (You can call me DNFBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
The agreement was validated by .NET Foundation and real humans are currently evaluating your PR.
TTYL, DNFBOT;

:shipit:

Travis is failing

@khellang can you rebase this on top of dev, we fixed the ci.

Hmm. Rebased, but still failing. Seems unrelated tho

Yea that one is a known issue.

:+1: good stuff

@khellang Thanks for the PR!

NP, I have another one cooking for the "official" BuildFunc (though it hasn't been finalized yet).


iruby: 0.3 -> 0.7.4, fix build, and add update script

Description of changes
The iruby in Nixpkgs is currently broken. This PR fixes it and updates it from 0.3 to 0.7.4.
I also added an update script to make it easier to update in the future.
I'm working on a separate PR that will provide a test so it doesn't get broken again.
Things done

Built on platform(s)

[X] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[X] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[X] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[X] Fits CONTRIBUTING.md.

Could I trouble you to look at this @natsukium ? It's another Jupyter fix. Now that #245340 is landed, you can verify this fixes the kernel like this:
nix run --impure --expr 'with import <nixpkgs> {}; jupyter-console.withSingleKernel iruby.definition'

Thanks for the review! Just finished responding.

I think I figured it out, needed to use export BUNDLE_FORCE_RUBY_PLATFORM=1


Sample data lines for Turkish or English

I want to use Morfessor to separate Turkish words into stem+suffixes.
I don't have a sample database. So, I must create a new data set for training.
Can you give me some explanatory example data lines in Turkish, or English that should be in the data set?
Thanks.

Have you noticed Morfessor FlatCat https://github.com/aalto-speech/flatcat ? It may be more suitable for your needs, if you want to distinguish between stems and suffixes.
Some Turkish data is available from http://morpho.aalto.fi/events/morphochallenge2010/datasets.shtml .
Note that the words have been lowercased, and mapped onto latin characters by replacing the letters specific to the Turkish language are replaced by capital letters. You may need to do some transformations on your data before training or use.


data stream memory leak if not unsubscribe correctly

when we convert a state to a data stream, if it is subscribed by downstream, it will cause self-reference. At this time, if the downstream does not actively unsubscribe, it will cause memory leak.
let state = State::value(0);
let c_state = state.clone();
let _h = state
  .modifies()
  // `c_state` will be stored in a `Subject` of the `state`.
  .map(move |_| *c_state.read())
  .subscribe(|v| println!("{}", v));

// if we not call `_h.unsubscribe()` in a right time, it will cause memory leak.

To solve this problem,

we should provide a way to only capture the value part of the state ?
or warning user need to unsubscribe and provide a  method like on_dispose to call this.

We should not choose to use Weak reference, because the it is too verbose.

closed by #556


 Skipped images are jpg image according to name. All images can be opened and viewed on Windows.
To Reproduce
Steps to reproduce the behavior:

Create new project
Use the dataset given. Download here. I included one valid jpg image. Others are invalid.

Expected behavior
All image successfully loaded
Screenshots
Valid image type - Detected as jpg

Invalid image type - Detected as WebP

Desktop (please complete the following information):

OS: Windows
Browser: Chromium

Additional context
These images are from vehicleplate labellers.

After discussion with the team, will allow webp image format in future.


[openexr] fixup pkgconfig

What does your PR fix?
The generated .pc file for openexr contains an absolute path. This PR fixes that.

Which triplets are supported/not supported? Have you updated the CI baseline?
No changes.

Does your PR follow the maintainer guide?
Yes, to the best of my knowledge.

Yes.

Unfortunately, it is no enough. For debug, libraries are build with a _d suffix:
$ ls packages/openexr_x64-linux-dynamic/debug/lib
libHalf-2_5_d.so            libIlmImf-2_5_d.so.24.0.0
libHalf-2_5_d.so.24         libIlmImfUtil-2_5_d.so
libHalf-2_5_d.so.24.0.0     libIlmImfUtil-2_5_d.so.24
libIex-2_5_d.so             libIlmImfUtil-2_5_d.so.24.0.0
libIex-2_5_d.so.24          libIlmThread-2_5_d.so
libIex-2_5_d.so.24.0.0      libIlmThread-2_5_d.so.24
libIexMath-2_5_d.so         libIlmThread-2_5_d.so.24.0.0
libIexMath-2_5_d.so.24      libImath-2_5_d.so
libIexMath-2_5_d.so.24.0.0  libImath-2_5_d.so.24
libIlmImf-2_5_d.so          libImath-2_5_d.so.24.0.0
libIlmImf-2_5_d.so.24       pkgconfig

Fortunately, given the libsuffix=-2_5 line, it is probably easy to fix by substituting =-2_5 with =-2_5_d in files matching glob ${CURRENT_PACKAGES_DIR}/debug/lib/pkgconfig/*.pc.

Many thanks for catching @dg0yt, I appreciate you looking over this. Any objection to instead simply setting CMAKE_DEBUG_POSTFIX to the empty string as in the commit I just added?

(Note https://github.com/AcademySoftwareFoundation/openexr/blob/master/cmake/OpenEXRSetup.cmake#L72 so it really needs to be explicitly set to the empty string.)

Any objection to instead simply setting CMAKE_DEBUG_POSTFIX to the empty string as in the commit I just added?

IMO it is fine, as long as library names match exported cmake and pkgconfig configuration. It seems hardly possibly to use these libs correctly without exported configuration. (I will know more when I add openexr support to port gdal.)
However, vcpkg policy is to not rename binaries outside the names given by upstream. Decision left to approvers.

Thanks, and sure, I asked explicitly because of that policy. Using an upstream configurable setting to fix issues with the upstream exported .pc configuration would seem within reasonable boundaries to me and guarantees all configurations (cmake, pkgconfig) remain in sync; it's not like renaming the libraries post-installation.
But if it's not ok, I'd be happy to try to fix the openexr .pc generation with a patch that can be upstreamed. However, I really rather go for the currently proposed and much simpler solution, not requiring any special case regexp-ing of the .pc files, and not requiring any upstreamable patches.

However, vcpkg policy is to not rename binaries outside the names given by upstream. Decision left to approvers.

Policy is policy. You don't know if a downstream port has a custom Find<Whatever> which depends on the upstream naming schema.

Sure. I've posted a patch upstream.

There's some non-trivial discussion upstream on how best to fix this. I'll put this back on draft until the outcome of that discussion is clear, so I can add the final upstream patch.

Please ping me if this PR is ready for review.

@JackBoosY Thanks, your message was perfectly timed: upstream just merged the patch! It's ready now for review.

LGTM, thanks @mcmtroffaes :)


Don't untag atomic-openshift when ocp3 fails

This behavior is inconsistent with ocp4 build, and causes mixed rpm versions in plashet.

+1 for removing this logic, it has caught me by surprise as well.

+1 for removing this logic, it has caught me by surprise as well.


HTML: format document issue

VSCode Version: Code 1.14.2 (cb82febafda0c8c199b9201ad274e25d9a76874e, 2017-07-19T23:34:09.706Z)
OS Version: Windows_NT ia32 10.0.15063

the origin file is:

"Format Document" does nothing with default settings.
If I remove "span" from "html.format.unformatted"

The first "a" element is formatted too, and it's unnecessary.
The Visual Studio's format:

As a user, I don't like some html.format.unformatted settings, Visual Studio's format(html, xml etc) is what I want.
test.html.zip

Another format issue:
<address>
    Written by <a<EMAIL_ADDRESS>Doe.

   Visit us at:

    Example.com

    Box 564, Disneyland

    USA
</address>

format using VSCode:

format using VS:

VSCode shouldn't change it to 2 lines.

Please file these suggestions against https://github.com/beautify-web/js-beautify/issues which is the formatter we use under the hood.


validationmessage on regex patter

Postcode: does not match the pattern ^[1-9][0-9]{3} ?(?!SA|SD|SS)[A-Z]{2}$
this is not understandable for a regular user, it would be nice to be able to edit a custom message
Of course you can use a normal validation for this like
valid = (/^[1-9][0-9]{3} ?(?!SA|SD|SS)[A-Z]{2}$/.test(input)) ? true : 'some message';
so maybe the editable regex pattern is not needed

This is already possible with custom validation; you can do your custom js logic, and if it fails, set valid to your error message.

I mentioned that with the custom validation code. I mean that the editable regex pattern (the input field on the validation tab) is not usable without a custom message.

I see the disconnect, ignore the validation regex input and only use a custom validator like this:
valid = (/^[1-9][0-9]{3} ?(?!SA|SD|SS)[A-Z]{2}$/.test(input)) ? true : 'some message';


Add sample matcher tests

/cc @JamesNK @kichalla
I wanted to put this out there for early feedback on the general direction. If y'all find it acceptable/promising then I'll start dumping in test cases from our existing test sets.

@JamesNK @kichalla - any comments on this idea?

OK Cool beans, I'm going to clean this up based on @JamesNK comments and then merge. Then I'll be adding a few more matcher implementations and more tests


Default aggregation for sap.m.ActionSheet

Some controls got a defaultAggregation, some don't. Why?

Thanks for your contribution! We merged this internally.


Require seller bond to create new listing

Implemented user account bond: https://github.com/yzernik/squeakroad/pull/490


Reaction quick menu is occasionally out of place

Is this in reference to the menu being above the message and Reactions being below them?

Updated with screenshot.


wip: Reviewing and enhancing fields inline documentation (proc.*)

What type of PR is this?

Uncomment one (or more) /kind <> lines:

/kind bug

/kind cleanup

/kind design

/kind documentation

/kind failing-test

/kind feature

Any specific area of the project related to this PR?

Uncomment one (or more) /area <> lines:

/area API-version

/area build

/area CI

/area driver-kmod

/area driver-bpf

/area driver-modern-bpf

/area libscap-engine-bpf

/area libscap-engine-gvisor

/area libscap-engine-kmod

/area libscap-engine-modern-bpf

/area libscap-engine-nodriver

/area libscap-engine-noop

/area libscap-engine-source-plugin

/area libscap-engine-savefile

/area libscap

/area libpman

/area libsinsp

/area tests

/area proposals

Does this PR require a change in the driver versions?

/version driver-API-version-major

/version driver-API-version-minor

/version driver-API-version-patch

/version driver-SCHEMA-version-major

/version driver-SCHEMA-version-minor

/version driver-SCHEMA-version-patch

What this PR does / why we need it:
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

NONE

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: leogr
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [leogr]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@falcosecurity/libs-maintainers
This first enhancements is already ready for review, and can be tentatively merged for
/milestone 0.16.0

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: incertum, leogr
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [incertum,leogr]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: FedeDP, incertum, leogr
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [FedeDP,incertum,leogr]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


set.Pin() Method

The “Multibus_simple” examples tries to invoke a “setPin()” method on variable ds18x20 of type OneWire. However, this method does not appear to be defined in the OneWire library.

Sorry, I see this issue has already been brought up and closed.


Add Honeybadger to Vendor Management

I just logged into HoneyBadger and my account has been removed from all projects. Please make sure LibSys staff are added to to Vendor Management project. Thanks!


Fix the issue that some undefined elements are added to tabs.

I've figured out (hopefully only) the source of undefined elements in the tabs array and made a patch to fix the issue.
This fixes #326.
Actually, there was one more suspect, the callback for chrome.tabs.get inside the listener for chrome.tabs.onReplaced, since the tab might have already been closed.
But I observed no errors without the modification to that part, so the part remained unchanged.

That's awesome, thank you for taking the time to dig into this, I'll check it out locally and get an update out in the next day or 2.
Evan


Error when using ParentSize - unrecognized prop enableDebounceLeadingCall

Greetings.
I'm seeing an error  React does not recognize the 'enableDebounceLeadingCall' prop on a DOM element. when using ParentSize
I believe it is because enableDebounceLeadingCall is caught in ...restProps, which is then passed to the div.
const { className, children, debounceTime, parentSizeStyles, ...restProps } = this.props;
return (
  <div style={parentSizeStyles} ref={this.setTarget} className={className} {...restProps}>
...

Fixed in https://github.com/hshoff/vx/issues/762 will be released in v0.0.199


ASF-Config Generator.exe

The program AFS-Config Generator.exe no configuration SteamTradeMatcher

Then maybe update it instead of using outdated version?


x/build: "fatal error: out of memory" on windows-arm64-11

#!watchflakes
post <- builder ~ `^windows-arm64.*` && `fatal error: .*(?:out of memory|cannot allocate memory|The paging file is too small|Insufficient system resources)`

greplogs --dashboard -md -l -e '(?ms)\Awindows-arm64.*^fatal error: out of memory' --since=2021-01-01
2022-02-04T14:02:15-25d2ab2-4afcc9f/windows-arm64-11
We may need to reconfigure the builder to either turn down the build/test parallelism or have more RAM available.
There is only one of these failures in the logs, but OTOH this builder has only ever run x/tools 12 times — so that's an 8% failure rate for this repo so far. 😅
(attn @golang/release)

So far I'm not seeing any recurrences on what I assume is a much higher number of runs. We can keep an eye on it but right now I'm inclined to leave it alone.

So far I'm not seeing any recurrences

Here's one running x/crypto:
greplogs --dashboard -md -l -e '(?ms)\Awindows-arm64.*^fatal error: out of memory' --since=2022-02-05
2022-02-10T15:16:21-f4118a5-656d3f4/windows-arm64-11

From the sheer number of packages that failed in each of those logs, I suspect that the parallelism is being set to high. What's the CPU-to-RAM ratio for this builder? (Maybe we could scale down GOMAXPROCS?)

About 12G RAM for 8 cores, which seems pretty plausible to me? There isn't much precedent for tweaking GOMAXPROCS but I guess it's worth a try.
...are the crypto tests really that memory hungry though? Smells weird.

CL 381514 for #50084 is recent precedent.

are the crypto tests really that memory hungry though? Smells weird.

I agree. It looks like the actual OOM happened while recompiling packages in std, so probably more about compiler memory usage than test memory usage per se — but it's not clear to me why those packages would have been stale in the first place. 🤔

Unfortunately still OOMing even with GOMAXPROCS=4.
greplogs --dashboard -md -l -e '(?ms)\Awindows-arm64.*^fatal error: out of memory' --since=2022-02-12
2022-02-15T14:54:27-76bd8ea/windows-arm64-11
It's not at all clear to me why this is happening for the -11 builder but not the -10 builder — are they running on different host configurations?

Oh, hrm. The failure condition in that last one is a bit different — it OOMed during bootstrapping. 🤔

Three more OOMs over the weekend: one during bootstrapping in the main repo, and two during x/tools builds.
greplogs --dashboard -md -l -e '(?ms)\Awindows-arm64.*^fatal error: .*(?:out of memory|cannot allocate memory)' --since=2022-02-16
2022-02-20T20:58:11-851ecea/windows-arm64-11
2022-02-17T17:37:24-1f3875c-eaf0405/windows-arm64-11
2022-02-17T17:37:03-fd59bdf-eaf0405/windows-arm64-11

Still ongoing:
greplogs --dashboard -md -l -e '(?ms)\Awindows-arm64.*^fatal error: .*(?:out of memory|cannot allocate memory)' --since=2022-02-23
2022-03-15T13:54:34-6799a7a-e475cf2/windows-arm64-11
2022-03-14T09:19:01-b769efc-ab0f761/windows-arm64-11
2022-03-12T23:32:36-842d37e/windows-arm64-11

We got bit twice during the release during bootstrap too. But I have no idea what to do about it.

Yep, same qemu script. My best guess is some kind of OS issue/conflict with the emulator, but I have no idea how to prove or disprove that belief.

I wonder if this is somehow related to #49564, in that they both involve unexpected OOM failures on Windows.

@golang/release, is there a way to get the runtime to dump the current heap size when it fails with cannot allocate memory? It would probably be useful to know whether these OOMs are occurring due to wildly oversized heaps like the ones in #49564.

Here's a new (but likely related) failure mode:
windows-arm64-11 at a41e37f56a4fc2523ac88a76bf54ba3e45dcf533
…
Building Go cmd/dist using C:\workdir\go1.4
go tool compile: fork/exec C:\workdir\go1.4\pkg\tool\windows_arm64\compile.exe: The paging file is too small for this operation to complete.

The above failure mode suggests that there is a problem with the builder itself, not (just) #52433, since that failure occurred during bootstrapping using the old and venerable go1.4 toolchain.

greplogs -l -e '(?ms)\Awindows-arm64.*^fatal error: .*(?:out of memory|cannot allocate memory)' --since=2022-05-10
2022-05-16T06:55:54-86c51ed-9956996/windows-arm64-11
2022-05-14T23:57:43-335569b/windows-arm64-11
2022-05-14T23:57:43-0976fa6-335569b/windows-arm64-11
2022-05-14T15:26:27-19156a5/windows-arm64-11

@qmuntal, this is one of the issues I think should block promoting windows/arm64 to a first class port.

(You can find other windows/arm64 bugs here:
https://github.com/golang/go/issues?q=is%3Aissue+is%3Aopen++in%3Atitle+label%3Aarch-arm64+label%3Aos-windows
However, it's not clear to me which of those should be blockers to making windows/arm64 a first-class port; most of them have been mitigated by adding skips to the affected tests.)

Tracking the new Microsoft-provided windows/arm64 builder in #53541, which will hopefully fix this issue.

It seems the "fatal error: out of memory" problem hasn't been reported here for a while. One possible explanation is that we've updated the host OS version where the qemu emulator is running (one of the -11 builders was on a particularly old macOS 11.0, which lines up with https://github.com/golang/go/issues/51019#issuecomment-1096709897).
I'll close this issue optimistically; please feel free to reopen otherwise.

The first page of the build dashboard shows 4 windows-arm64-11 fails that are all memory related, reopening.

Tracking the new Microsoft-provided windows/arm64 builder in #53541, which will hopefully fix this issue.

I'm no longer sure this is a builder issue. I'm facing some OOM errors like this one runtime: VirtualAlloc of<PHONE_NUMBER>12 bytes failed with errno=1455 while running a test that shouldn't need 274GB to run... There could be a problem in the runtime, will give it a try.

I'm no longer sure this is a builder issue. I'm facing some OOM errors like this one runtime: VirtualAlloc of<PHONE_NUMBER>12 bytes failed with errno=1455

I can't reproduce this issue anymore, and there hasn't been any memory-related issues since the windows/arm64 builders were deployed on Azure instead of using qemu on Mac. I propose to close this now.

Thanks. If there's new evidence of this occurring, we can reopen or file a new issue.


JavaScript Errror: TypeError: f.filter is not a function

Hello, this looks like a cool project.
I've been looking for a FastAPI compatible memory profiler for a while.
I'm not sure if this project is still maintained but I ran into this JavaScript error.
I see the UI appear for a fraction of a second and then it goes away.

Tried to follow the examples in the readme.
https://github.com/Kilo59/coronavirus-tracker-api/blob/pyloot/app/profiling.py
https://github.com/Kilo59/coronavirus-tracker-api/blob/pyloot/app/main.py#L49-L50
I'm running it locally with uvicorn.
https://github.com/Kilo59/coronavirus-tracker-api/blob/pyloot/Pipfile#L44

@Kilo59 Hello thanks for checking out the project!
I've downloaded your project and found that the issue is from having gzip encoding enabled explicitly.
pyloot also does its own gzip encoding. Thus encoding was happening twice and malformed data was returned.
I've added an option to pyloot to disable gzip encoding. I've also made the error handling a bit more graceful so that a nice error message is displayed instead of a white screen.
README is updated with instructions. The new version should publish automatically soon. Give it a try and add a comment if it does not solve your issue.

Version 0.0.6 is published


Swift: redundant modifiers in extension methods

Xcode 10.2 reports a few new warnings regarding how quicktype creates functions within extensions:

Text for ⌘F'ers:

warning: 'public' modifier is redundant for initializer declared in a public extension

Fixed in https://github.com/quicktype/quicktype/pull/1198.


[PROJECT ONBOARDING] Flatcar

Welcome to CNCF Project Onboarding
This is an issue created to help onboard your project into the CNCF after the TOC has voted to accept your project into the Sandbox.
We would like your project to complete onboarding within one month of acceptance.
Please track your progress by using "Quote reply" to create your own copy of this checklist in an issue, so that you can update the status as you finish items.
Review and understand

[ ] The Technical Leadership Principles that outlines the expected behavior for any maintainer in a leadership role.
[ ] The project proposal process and requirements.
[ ] The services available for your project at the CNCF.
[ ] The CNCF IP Policy.
[ ] The trademark guidelines.
[ ] The license allowlist.
[ ] The online program guidelines.
[ ] Optional: Book time with CNCF staff for any onboarding questions.

Contribute and transfer

[x] Move your project to its own separate neutral GitHub organization. This will make it transferable to the CNCF's GitHub Enterprise account. If it's already in a GHE account, you will need to remove it from that first.
[x] Accept the invite to join the CNCF GitHub Enterprise account. We'll then add thelinuxfoundation as an organization owner to ensure neutral hosting of your project.
[ ] Migrate your Slack channels (if any) to the Kubernetes or CNCF Slack workspace. CNCF staff can help.
[x] Submit a pull request to add your project as a Sandbox project to the Cloud Native Landscape by updating landscape.yml following these instructions.
[ ] Transfer your domain to the CNCF. The "LF Stakeholder email" is<EMAIL_ADDRESS>[ ] Transfer any trademark and logo assets to the Linux Foundation.
[ ] Submit a pull request with your artwork.
[ ] Transfer website analytics to<EMAIL_ADDRESS>CNCF staff can help.

Update and document

[ ] Ensure that DCO (preferred) or CLA are enabled for all GitHub repositories of the project.
[ ] Ensure that that the CNCF Code of Conduct (or your adopted version of it) are explicitly referenced at the project's README on GitHub.
[ ] Ensure LF footer is on your website and guidelines are followed (if your project doesn't have a dedicated website, please adopt those guidelines for the README file).
[ ] Create a maintainer list and add it to the aggregated CNCF maintainer list via pull request.
[x] Provide emails for the maintainers to get access to the maintainers mailing list and Service Desk. Email them to<EMAIL_ADDRESS>[ ] Start working on written, open governance.
[ ] Start on an OpenSSF Best Practices Badge.

CNCF staff tasks

[x] Add the project to DevStats.
[ ] Add the project to CLOmonitor.
[ ] Add the project to LFX Insights. This is done by adding a read-only app to your GitHub organization once it's in CNCF GHE.
[ ] Add the project to LFX Project Control Center.
[ ] Add a license scanning tool, like FOSSA or Snyk.
[ ] Invite developers to the #maintainers-circle Slack channel.
[ ] Send a welcome email to confirm maintainer list access.

@Cmierly can you please request to add the project to PCC?
They are looking to set up community meetings. I can only do that once they are active in PCC.

Hi @riaankleinhans, marking Flatcar active in PCC is now dependent on completing the trademark docs. There is a new process here for managing that digitally. Crystal and I will share those docs soon.

Hi @riaankleinhans, marking Flatcar active in PCC is now dependent on completing the trademark docs. There is a new process here for managing that digitally. Crystal and I will share those docs soon.

Thank you!

Hi @riaankleinhans, marking Flatcar active in PCC is now dependent on completing the trademark docs. There is a new process here for managing that digitally. Crystal and I will share those docs soon.

krook- Just checking in, to see if there is anything we could help with?

Project has been added to CLOMonitor


Import Android SDK 3

What does this PR do?
Import the SDK Android 3 in the new documentation.
Content is imported "as-is", only the snippets are extracted but not tested.
How should this be manually tested?

Step 1 :
Step 2 :
Step 3 :

 Snippets tests reports   SDK Version Tests overview      v6        v5                                   :heavy_minus_sign:                    v1        v1        v1

See my JS SDK question.
My remark about the "alpha tag" in the PHP SDK PR also applies here.


Add wireless options for 802.11r

Subset of #5 to include only 802.11r options.
I thought this was easier to move forward with and sort the IPv6 option separately.

Ok, I will merge this and make my own changes so that you can disable IPv6. Please consider not to deactivate IPv6 though. Most of the times it seems convenient but I strongly suggest to take a look into it, because it's really to not ignore it.

Thank you. It's been years since I learnt IPv6 and I have no need for it on the inside interfaces.


fft1d has issues for higher lengths > 32

HI,
The FFT seems to work for data of length 32  (the example on the github works). The results are the same when compared by computing FFT in matlab. For data of higher lengths (~16384) however the FFT seems to give weird results (values are very high as compared to Matlab) gives results of the order of 10^-13 while this toolbox gives values in range of 10-100s. Any ideas?
Thanks,
Chiran

Now you have to push your fix and close the issue. The bug still existing.

But it is not a fix, it's a hack. Like I mentioned, there should be a proper fix, that will take the _n into account etc.

fix the bug, close this issue.


Export don't work for queryset with values() method

Hello! Exporting fields don't work when queryset used with values() method. This is because when we iterate over queryset we have dict rather than model instance.
I think code in resources.py must be like this:
def export_field(self, field, obj):
        if isinstance(obj, dict):
            return obj.get(field.attribute)
        field_name = self.get_field_name(field)
        method = getattr(self, 'dehydrate_%s' % field_name, None)
        if method is not None:
            return method(obj)
        return field.export(obj)

We can't using queryset without values() because this using for GROUP BY. So I think import_export must support it

Does this issue need to a Pull Request for done resolution?

Alternatively, instead of defining the value in the query, declare it in the resource class, as it has already been documented here.


Windows build: createdb.js fails with ERRORLEVEL 3

I built node-sqlite3 (in Release) for Windows using the work of TooTallNate here: https://github.com/developmentseed/node-sqlite3/pull/61 and verified that the small Ipsum Lorem example in the README.md worked as expected, using node 0.6.10.
Then I tried to node createdb.js.  After the usual spike in memory use, I ended up with a big.db of zero bytes and "DOS" ERRORLEVEL equal to 3.
If I reduce the number of rows inserted by createdb.js from 10 million to 1 million, I get a database of size consistent with expectations (about 65MB) for the random strings.
Platform is 32-bit Windows XP.
My typical uses of sqlite are for small test databases, so I have no idea if this is an issue with SQLite on Windows (I know for a fact that this problem does not occur on 64-bit Linux where I have build and tested node-sqlite3 with node0.6.10.) or node or node-sqlite on Windows.
Please let me know how I can provide a more useful report.

Forgot to mention... this box has 2GB of RAM and plenty of swap space

I have verified the same behavior on a second 32-bit Windows XP box.
node .\test\support\createdb.js ==> abnormal termination, zero-size for big.db
The pagefile grows to about 2.4GB (from a quiescent state of ~500MB) and then node dies.

I wonder if the problem has something to do with transaction buffering on on Windows.  I probably will not have time to test this week...


10/29/2018 21:55 : Create Pull Request for branch master -> prTesting1_2018102921

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details
Dependent Files

split/updateTestCon1.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


It cannot run on the Windows 11 platform, but it can run on the Windows 10 platform.

.\trip.exe www.baidu.com -v -m json > rv.txt
Uploading rv.txt…

Thank you.
Before we do anything else please confirm that you have read https://github.com/fujiapple852/trippy#why-does-trippy-show-awaiting-data and that you have enabled ICMP traffic in Windows defender.

@isjarvi to confirm your situation:

You run trip.exe www.baidu.com -m json on Windows 10 and you get the expected output
You run trip.exe www.baidu.com -m json on Windows 11 and you get the following "empty" output:

{
  "info": {
    "target": {
      "ip": "<IP_ADDRESS>",
      "hostname": "www.baidu.com"
    }
  },
  "hops": []
}

You have configured both Windows 10 and Windows 11 to enable ICMP in Windows defender

What the debug logging shows is that Trippy sent 23 ICMP probes per round (for 10 rounds) but did not receive any responses.
This almost always indicates a firewall issue (Windows defender or some other 3rd party firewall or AV tool), however given Trippy has never been tested on Windows 11 then I can't rule out some change in behaviour on Windows 11 that is incompatible with Trippy.  It could also be that the instructions for allowing ICMP traffic in Windows defender that I linked to are incompatible with Windows 11.
As a next step I would suggest you install and run a tool like Wireshark and capture all outgoing and incoming ICMP packets whilst Trippy is running.  This will show us that either (i) response packets are not being received by the OS or (ii) the OS is not delivering those packets to Trippy.
You may also want to try tracing with UDP and TCP to see if that makes a difference.
Looking at the VirtualBox website it claims to support Windows 11 these days and it seems the Windows 11 ISO can be downloaded so I may try to setup a Windows 11 VM to test.

@isjarvi I just:

installed Windows 11 in VirtualBox and then did a
Updated winget to 1.6
Ran winget install trippy
Ran trip.exe www.baidu.com -m json -> no output

In then crated the needed Windows Defender rules (as shown in https://github.com/fujiapple852/trippy#why-does-trippy-show-awaiting-data):

Ran New-NetFirewallRule -DisplayName "ICMP Trippy Allow" -Name ICMP_TRIPPY_ALLOW -Protocol ICMPv4 -Action Allow
Ran trip.exe www.baidu.com -m json -> output as expected

Therefore we can conclude that Trippy works as expected on Windows 11.
Please double check your Windows Defender setting and any other firewall or AV product you have installed.

I tested it on WIN 11 and it worked for me. I can check again but haven't quite followed everything in this issue yet. Will try to read it in more detail later but just wanted to confirm that I tested the release candidate on Win 11 and it worked for me.

I'm going to close this as it does not appear to be an issue with Trippy.


Need to Migrate JCenter to mavenCentral

Hi Team,
As JCenter is shutting down and we need to migrate to mavenCentral.

已经从Jcenter迁移到github了，你可以使用最新的集成方式


Emergency Button/ Did not understand button

During a lecture students struggle to understand certain topics and are to intimidated to ask questions/mind asking something in the forum. Therefore, a Emergency/Didnot understand button is proposed to collect timemarks, where students have problems.
The button should be easily  accessible and have some introduction. For lecturers there should be the possibility to see the number of marks per video and quickly access those places in order to prepare extra content or clarify it in the discussion.
It might be worth discussing, whether other students should see the marks or not.
This is a first step towards #221 .

Should users be allowed to enter some question text to help the editor/lecturer to clarify their content?

Thanks for the great idea, it's now reality (already since April 2024) and is called "annotation tool". You can read more about it in our blog here or just start creating your own annotations in videos and share them with teachers (and lecture editors).


How to dynamically load data

Is there any way to use At.js to load data as I type? For instance similar to how @ works with facebook

It is in the documentation

how to use ?

@richardba


add note on testing and container access to "Basic" documentation

This addresses part of #193 by adding a note on container access to the "Basic" section of the docs.
Hopefully this helps any developers (myself included) who might be prone to encounter the issue noted in #191 😄.

@BrianSipple this is great. Thank you. I've been meaning to add a note like that for some time now and never got a chance to.