IP objects

This is the implementation of #290 on port and socket level.
For example use in components see 2 test cases here: https://github.com/trustmaster/noflo/blob/ip-objects/spec/Component.coffee#L212
I had to pick some new method names to keep the old API fully available.
The InPort maintains compatibility layer between the old raw packets with 7 event types and the new object packets with 1 event type. So the old-style components can be combined with new-style components within the same graph.
I've added InternalSocket.post() method because connect/disconnect events are now considered as optional. This is to avoid the annoying disconnect() every time you just want to send a single packet, and to avoid littering the compatibility layer with unnecessary openBracket/closeBracket packets.
Comments and suggestions are welcome.
TODO

[ ] Describe packet cloning use cases
[ ] Improve/implement cloning interfaces and underlying code
[ ] Add IP.toString() method providing as much sensitive debug information as possible

So scope could be also used for flow isolation with https://github.com/noflo/noflo-runtime-msgflo ?

@bergie yes, for scope should be used for any isolation/scoping purpose.

Added checklist in the opening post.
I need some help identifying use cases for cloning packets vs. passing by reference.

Will fix #290

The checklist items can be handled as separate issues. However, would be nice to have something about IP objects in the CHANGES file


Added audio-in-javascript.md

Added snippet for adding audio file a a webpage

hey, what can i do get this pr merged.

hey, what can i do to get this pr merged?


Add commit body metadata cop.

In a project I am working in, we have tags in the commit message, something like:
[api][webui] Change something in api and webui
[api] Change that only affect api
What about a cop for ensuring that all commit have at least one tag. It should not to be enabled by default, as probably most projects don't have tags and to have a whitelist with the allowed tasks.

Yeah, that's an interesting idea. Do you use these in the commit subjects or the bodies? These tags, or metadata, should live within the body as much as possible. Much like how [ci skip] can be added to a body to skip a build (like a documentation update or something).
How are you using these tags? Are you using a reporting tool to do something with the tags and group commits by tag?
If a cop was introduced to check for these tags it would probably need a regular expression pattern to account for tags that get added but are not in the whitelist but look like a tag. That or the position of the tags would need to be at the end of the body. For example:
Example subject line.

Example body...

[ci skip]

The tags are in the commit body always at the beginning, as the idea is to make more visible what part of the app is being changed without having to read the whole description.
But I guess once this is implemented, it would hurt make it configurable, in case someone else want to put then at the end.

Ah, good. I'd love to keep them at the end if at all possible. To me, that's metadata that doesn't need to be read immediately. Useful to have but even better if some other tool is being used to do analysis on it. I always look for the body to explain why the commit is important as it helps give me context before diving into the code diff.

@bkuhlmann

Ah, good. I'd love to keep them at the end if at all possible.

Well, if I make it configurable, so the tags can be at the beginning or at the end, this shouldn't be a problem, right? I mean:
OPTION 1
[ci skip] Example subject line.

Example body...

OPTION 2
Example subject line.

Example body...

[ci skip]

In order words, if I send a PR for this cop with the tags being configurable to be at the beginning or at the end, would you be fine with it?

Hmm, I really like Option 2. It's elegant and clean. I've seen tags used as subject prefixes before but never liked that style because it forces the reader to sift through metadata before getting to the actual content. It's important that the commit remain readable.
I really like this format:
<subject - what the commit is about>

<body - why the commit is necessary>

<metadata - various tags, etc. that categorize the commit>

The metadata should always be at the bottom. This keeps the commit clean, and human readable first and foremost. It allows for additional tools to consume the metadata for static analysis. This could be useful for tools, like Milestoner, when building release notes.
This also gives the commit a clear structure without too many options. It'll also keep the implementation simple by not having to check for metadata in multiple locations.
What do you think?
BTW, should tags always be in this format?
[name]
It always starts and ends with [, ]? Is the body of the tag always a word or phrase? Any special characters restrictions within the tag name?

@bkuhlmann but the thing is that in the project I am working on they need to be in the commit subject. For example, we have the frontend and the backend (two different applications) in the same repository. They are even written in different languages. So, that means that a developer working in the frontend is not interested at all in the commits with the [backend] tag. That's one of the reason why they have to be in the subject. Also, it is already done like that for years, so even if we wanted to change this, it would be impossible.
What would be the problem in supporting both, tags at the begging of the subject or at the end of the commit message and making it configurable? So, you could disable or enable option 2 in your projects and I could enable option 1. And everybody happy :smile: I am not trying to say that option1 is better than option2. I get your point, it is just that in the project I am working only option1 can be used.
Regarding the tags. My idea is that the tags are in a whitelist, to avoid that you can write whatever you want. In the practice we are only using 6 tags. And about the format, we use [name1][name2][name3], but again we could have [name1][name2][name3] and [name1, name2, name3] and then allow that everybody configure it as he wants.
To be able to add git-cop in my project I would need it to support this cop with option1. I would be up to send a PR, with all configuration options to make it also useful for you/other people.

Hmm, that is interesting regarding legacy support. Retrofitting this gem to support legacy projects will make this harder to maintain and downgrade it being effective in pushing projects forward to higher standards, I'm afraid.
This isn't actually an issue with the gem but an issue with the way the company was organized for you, sadly.
That said, you can make the existing implementation work for your situation. :smile: Why not add the tags to the whitelist of the Commit Subject Prefix cop? This'll give you the ability to solve your needs for the allows subject lines (i.e. Option 1) and we can implement this feature strictly, for Option 2.
What do you think?

Regarding the format of the tags (i.e. Option 2). Let me do a little research first. I'm wondering if they should be strictly enforced as [tag]? Maybe <tag> or something else entirely. Let me get back to you on that. We might want to also ensure they they are space delimited. Example:
[one] [two] [three]
Rather than:
[one][two][three]
The space delimitation could be nice as it would make easier for downstream analytics tools.

@bkuhlmann

That said, you can make the existing implementation work for your situation. :smile: Why not add the tags to the whitelist of the Commit Subject Prefix cop? This'll give you the ability to solve your needs for what is allowed in your subject lines (i.e. Option 1) and we can implement this feature, strictly, for Option 2.
What do you think?

That's actually a good idea, with one problem, the whitelist would get too long as I will need something like:
[one] Fix
[two] Fix
[three] Fix
[one] Change
[two] Change
[three] Change
[one] Refactor
[two] Refactor
[three] Refactor
....

What about allowing to use regular expression in the white list? That would be really cool! :heart_eyes: I'll open a new issue as this is not necessary related with the tags. This would solve my problem so feel free to close this issue, or keep it if you still want to have tags in the format you proposed! :wink:

Ha, OK. Yeah, I'm going to close this for now. I'm not saying this isn't worth doing, just that I want to study more use cases first. For example, another options I've explored in the past and am thinking about again due to the discussion above is leveraging Git Notes.
Anyway, for now, I'm going to close this issue in favor of more research.


Add tests for compiler/repo_processor.py

Hi @maany,
I've added unit tests for all the functions in compiler/repo_processor.py for #27. Please review.
Thanks!

Perfect PR @snehasi :) ! Thanks


chore: ignore mpl-2 license warnings

Q
A

🐛 Bug fix?
no

🚀 New feature?
no

⚠ Deprecations?
no

❌ BC Break
no

🔗 Related issues
#...

❓ Documentation
no

Description
MPL-2.0 license is used by hashicorp libraries. We are acknowledging the use of it by including the information in each release. This PR adds snyk ignore to silence the warnings.

Codecov Report

Merging #1269 (02a6526) into main (c4816bf) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #1269   +/-   ##
=======================================
  Coverage   81.79%   81.79%
=======================================
  Files         398      398
  Lines       14411    14411
=======================================
  Hits        11787    11787
  Misses       2333     2333
  Partials      291      291


When obtaining album images and videos, only the images will be displayed and the content of the videos will not be displayed

Version
3.2.0
Platforms
Android
Device Model
SM-S911U
flutter info
[√] Flutter (Channel stable, 3.19.6, on Microsoft Windows [版本 10.0.22631.3737], locale zh-CN)
    • Flutter version 3.19.6 on channel stable at D:\flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 54e66469a9 (2 months ago), 2024-04-17 13:08:03 -0700
    • Engine revision c4cd48e186
    • Dart version 3.3.4
    • DevTools version 2.31.1
    • Pub download mirror https://pub.flutter-io.cn
    • Flutter download mirror https://storage.flutter-io.cn

[√] Windows Version (Installed version of Windows is version 10 or higher)

[√] Android toolchain - develop for Android devices (Android SDK version 34.0.0)
    • Android SDK at C:\Users\lalal\AppData\Local\Android\sdk
    • Platform android-34, build-tools 34.0.0
    • Java binary at: D:\Android Studio\jbr\bin\java
    • Java version OpenJDK Runtime Environment (build 17.0.10+0--11572160)
    • All Android licenses accepted.

[√] Chrome - develop for the web
    • Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe

[X] Visual Studio - develop Windows apps
    X Visual Studio not installed; this is necessary to develop Windows apps.
      Download at https://visualstudio.microsoft.com/downloads/.
      Please install the "Desktop development with C++" workload, including all of its default components

[√] Android Studio (version 2023.3)
    • Android Studio at D:\Android Studio
    • Flutter plugin can be installed from:
       https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
       https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 17.0.10+0--11572160)

[√] Connected device (4 available)
    • SM S911U (mobile) • RFCW901E96K • android-arm64  • Android 14 (API 34)
    • Windows (desktop) • windows     • windows-x64    • Microsoft Windows [版本 10.0.22631.3737]
    • Chrome (web)      • chrome      • web-javascript • Google Chrome 126.0.6478.127
    • Edge (web)        • edge        • web-javascript • Microsoft Edge 126.0.2592.56

[√] Network resources
    • All expected network resources are available.

! Doctor found issues in 1 category.

How to reproduce?
Using content retrieval in the demo
Logs
No response
Example code (optional)
Using var albums = await PhotoManager.getAssetPathList();  to directly display the obtained image does not include video content

Contact
No response

[√] Flutter (Channel stable, 3.19.6, on Microsoft Windows [版本 10.0.22631.3737], locale zh-CN)
• Flutter version 3.19.6 on channel stable at D:\flutter
• Upstream repository https://github.com/flutter/flutter.git
• Framework revision 54e66469a9 (2 months ago), 2024-04-17 13:08:03 -0700
• Engine revision c4cd48e186
• Dart version 3.3.4
• DevTools version 2.31.1
• Pub download mirror https://pub.flutter-io.cn
• Flutter download mirror https://storage.flutter-io.cn
[√] Windows Version (Installed version of Windows is version 10 or higher)
[√] Android toolchain - develop for Android devices (Android SDK version 34.0.0)
• Android SDK at C:\Users\lalal\AppData\Local\Android\sdk
• Platform android-34, build-tools 34.0.0
• Java binary at: D:\Android Studio\jbr\bin\java
• Java version OpenJDK Runtime Environment (build 17.0.10+0--11572160)
• All Android licenses accepted.
[√] Chrome - develop for the web
• Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe
[X] Visual Studio - develop Windows apps
X Visual Studio not installed; this is necessary to develop Windows apps.
Download at https://visualstudio.microsoft.com/downloads/.
Please install the "Desktop development with C++" workload, including all of its default components
[√] Android Studio (version 2023.3)
• Android Studio at D:\Android Studio
• Flutter plugin can be installed from:
https://plugins.jetbrains.com/plugin/9212-flutter
• Dart plugin can be installed from:
https://plugins.jetbrains.com/plugin/6351-dart
• Java version OpenJDK Runtime Environment (build 17.0.10+0--11572160)
[√] Connected device (4 available)
• SM S911U (mobile) • RFCW901E96K • android-arm64  • Android 14 (API 34)
• Windows (desktop) • windows     • windows-x64    • Microsoft Windows [版本 10.0.22631.3737]
• Chrome (web)      • chrome      • web-javascript • Google Chrome 126.0.6478.127
• Edge (web)        • edge        • web-javascript • Microsoft Edge 126.0.2592.56
[√] Network resources
• All expected network resources are available.
! Doctor found issues in 1 category.

Screenshots?

Same issue. Only on Android. iOS is working fine.

Solved it.
I had following line in AndroidManifest.xml:

This does not work on higher android devices. Do the following:

Solved it.
I had following line in AndroidManifest.xml:
<uses-permission android:name="android.permission.READ_EXTERNAL_STORAGE" />
This does not work on higher android devices. Do the following:
    <uses-permission android:name="android.permission.READ_MEDIA_IMAGES" />
    <uses-permission android:name="android.permission.READ_MEDIA_VIDEO" />
    <uses-permission android:name="android.permission.READ_MEDIA_AUDIO"/>```

Thank you for your answer, but I have tried it on my end and it still doesn't work. However, the video captured through wechat_camera_picker can be obtained using photo_manage

Thank you for your answer, but I have tried it on my end and it still doesn't work. However, the video captured through wechat_camera_picker can be obtained using photo_manage
    <uses-permission android:name="android.permission.READ_EXTERNAL_STORAGE"  android:maxSdkVersion="28" />     <uses-permission android:name="android.permission.READ_MEDIA_IMAGES" />     <uses-permission android:name="android.permission.READ_MEDIA_VIDEO" />     <uses-permission android:name="android.permission.READ_MEDIA_AUDIO"/>

Thank you for your answer, but I have tried it on my end and it still doesn't work. However, the video captured through wechat_camera_picker can be obtained using photo_manage
<uses-permission android:name="android.permission.READ_EXTERNAL_STORAGE"  android:maxSdkVersion="28" />
<uses-permission android:name="android.permission.READ_MEDIA_IMAGES" />
<uses-permission android:name="android.permission.READ_MEDIA_VIDEO" />
<uses-permission android:name="android.permission.READ_MEDIA_AUDIO"/>

Thank you for your answer, but I have tried it on my end and it still doesn't work. However, the video captured through wechat_camera_picker can be obtained using photo_manage <uses-permission android:name="android.permission.READ_EXTERNAL_STORAGE" android:maxSdkVersion="28" /> <uses-permission android:name="android.permission.READ_MEDIA_IMAGES" /> <uses-permission android:name="android.permission.READ_MEDIA_VIDEO" /> <uses-permission android:name="android.permission.READ_MEDIA_AUDIO"/>

Updated my comment. Check the last part.

Thank you for your answer, but I have tried it on my end and it still doesn't work. However, the video captured through wechat_camera_picker can be obtained using photo_manage <uses-permission android:name="android.permission.READ_EXTERNAL_STORAGE" android:maxSdkVersion="28" /> <uses-permission android:name="android.permission.READ_MEDIA_IMAGES" /> <uses-permission android:name="android.permission.READ_MEDIA_VIDEO" /> <uses-permission android:name="android.permission.READ_MEDIA_AUDIO"/>

Updated my comment. Check the last part.

I have already obtained permission to modify the video before obtaining it, and the status returned is: PermissionStatus. granted

Uninstall the app and try again. Permission.photos.request do not seem to work as said.

Uninstall the app and try again. Permission.photos.request do not seem to work as said.

I always reinstall after adding permissions

Maybe you can create a demo and try it out @jasminder


[Util] Get spawn location of dimension/Save

Create open API for other mods to consume for getting Spawn Location of a specific dimension.

This will only work if the player is using a dimension they have loaded and we just update the spawn.
Or if the world is the main world, allowing us to use .getSpawnPos


Is it possible to disallow features at a cluster level?

we do not want developers to create stateful applications. Do do this, we do not want to allow for volume attachments.
we do not want allow users to create new networks on the clusters.
Is there a way to configure what types of features applications can use? Is this something the DEIS platform is interested in allowing at a configuration based level?

Actually I think this is a little confusing. I found out you guys dont support volumes at all. :) sweet win for me. I'll close this and rephrase if needed.

Feel free to ask questions on our slack channel! https://slack.deis.io/

To clarify for anyone who finds this thread in the future, Workflow currently is focused on 12factor apps only, which are inherently stateless, hence no current support for volume mounting.


need to update HTMLBars

Hi,
We are using this awesome package to generate fonts in our ember app. Now we are trying to upgrade from 2.7.0 to 2.9.0, during the process we are getting error in scss.hbs with variable '@key'. In ember 2.8 they have disallowed using @ in hbs templates. So we need to update htmlbars version to 4.0.5 so that we can use |key value| set in templates.
I have seen pull request , on using which its working fine locally. But to make it working on production i need to fork your 'broccoli-webfont' and 'ember-cli-webfont'. Can you update htmlbar package in your package.json so that i don't need to do fork those libraries.
Thanks,
Hari

#15 is merged.


wot and user window

The wot is made of : directly signed / signed by members, and far members (with distance > 1).
We need a user window, that can be used in many others (wot graph, list of members, contact...), where we can show to the user, informations about the member he clics on :
uid, pubkey, distance, way to reach it (for instance kimamila - galuel is distance 3, you can reach it thru distance 1 : vit, cgeek, inso..., distance 2 : (clic on vit, cgeek, inso...), etc... until galuel is reached). Date of entrance in the community, time from entrance to now... any usefull information one can have about one account.

Path between wallet member and selected member is now displayed in the WoT. Every other information are already displayed in the WoT or in the members table.
I will open an issue to add "entrance date" in the members table.

Finally, I will make the "member" popup window displaying member properties.

done in 2928a2bbebb77a75c9d52757b43a60ccdc08c04d


Rename and move RandomTest into test-sol/ directory

Scope
Rename RandomTest to RandomMock, and move the file to a new folder mocks/ in protocol/test-sol/unit/identity.
Context
From Slack:

Quick question: Any reason these two contracts should continue to exist as standalone contracts?
protocol/contracts/identity/test/ > RandomTest.sol. Are we keeping Random.sol on the L2?
protocol/contracts/common/libraries/test/ > BLS12Passthrough.sol. Are we keeping B12.sol on the L2?
I'm asking because RandomTest.sol and BLS12Passthrough.sol are the only smart contract tests that fail on forge test.
We can simply exclude them globally when running forge test, but I realised that I don't know if they are an artifact of the past or really in still use.
cc @blockchain-team (I believe RandomTest.sol is tested in the Cel1 geth client according to this PR: Add solidity wrappers for CIP-20/30/31 precompiles#10240)

random is no longer on L2. it was used by ASV1, which is deprecated.

Yes. We deprecated random. It’s on the specs docs

Looks like it's used here:
https://github.com/celo-org/celo-monorepo/blob/fec26237a8f409e79c107eab7f43cf8aa94f7c05/packages/protocol/test-sol/unit/identity/Random.t.sol#L14


fix: Fixes an issue with creation of crt Logger

Issue #

This corrects an issue @royjit found where one thread was creating the logger and another was creating the event loop in the crt and trying to call the logger before it had been created (race condition). the same thread should be creating both resources so the logger should be moved into the shared io file to be created there with all other crt types.
Scope

[ x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

This PR closes awslabs/aws-sdk-swift#514


When NoNeckPain mode toggled, running :bdelete also close the current window

First I'd like to thank you for writing this plugin, I've been wanting this kind of feature for so long!
Description
After running :NoNeckPain, running :bdelete will close the current window even if there are multiple other opened buffers. This means that running :bdelete will effectively close Neovim if no other windows has been created, even if other buffers are opened.
Steps to reproduce

Open Neovim
:e buffer1, :e buffer2
:NoNeckPain
:bdelete
Neovim closes even if there was still another buffer opened

Expected behavior
Only buffer buffer2 should have been closed.
Environment

Neovim: 0.8.1

Update: we quit nvim considering we closed the last window, while the event is a bufdelete. There should be a difference in how we handle those events.

Hey, please don't hesitate to try the fix :D

Hey just confirming the fix works for me. Thank you!


navigation pane rendering with Firefox

Dear pixeldroid,
thanks for this nice theme! I'm trying to set up a small github.io website but the rendering of the navigation pane is not nice when using Firefox (when more than 3 collections, the 1st sub element name is cut, see github.io.png). The rendering is fine (see local.png) using Firefox and local page done with jekyll serve. The github.io website is OK using Chromium or Falkon. So this is only using Github server and Firefox that I have the problem... Is there a way to avoid that? Maybe, to increase artificially the space between the collections and the sub elements? Thanks for you help!

The same is happening with me in safari for my own GitHub page. However, the official programming pages website works fine.


Add EF Core 7 support

Good to see "some" movement here, but do you realise .net core 8 is the current version? .net core 9 will be out next month and the current PR "upgrades" this to 7? 7 is end of life since May 2024 ... https://dotnet.microsoft.com/en-us/platform/support/policy/dotnet-core


GET /api/$spreadsheet-id/parser/$parser-name/pattern-components/pattern-123-here API to break up a parser into components

GET /api/$spreadsheet-id/parser/$parser-name/pattern-components/pattern-123-here

[
	"pattern",
	"alternatives": [
		"a",
		"b"
	]
],
[
	"123",
	"alternatives": []
],
[
	"here",
	"alternatives": [
		"not-here"
	]
],

Closed by https://github.com/mP1/walkingkooka-spreadsheet-server/pull/935


Libp2p unit test flake

https://buildkite.com/o-1-labs-2/mina-end-to-end-nightlies/builds/592#018b1a80-9a18-4caa-9a3c-6a433e05b803

split libp2p tests from dev unit tests in the short term

split mina_networking tests as well


[Azure Search] Implement NuGet search query parsing and mapping to Lucene query

This is as far as I got:
https://github.com/NuGet/NuGet.Services.Metadata/tree/jver-pq

Exact matches using KeywordAnalyzer, update index

[ ] Add exact match packageId here
[ ] Add exact match owners here
[ ] Add normalized version here


Suggest accessibility: items sometimes announced with a general name

Names of suggestions in the suggest widget are sometimes not announced, instead I get 'list', 'list item' or 'unknown'. Here's an example on how to repro:

vscode repo, open debugService.ts:119
this. trigger suggest widget - go through all the items and notice that not all of them will be read out, some will have the 'unknown', 'list'
coming back to the item, the correct name sometimes gets read out

I guess this is probably a bug in chrome or nvda

I have removed the proper way (using aria-autocomplete and aria-activedescendant) and implement this now using aria alerts due to https://bugs.chromium.org/p/chromium/issues/detail?id=593646


ipynb_exporter convert to html

Add a couple of options to the ipynb_exporter so that it can create static html versions of the notebook.

I've tested it with the latest ipython as well as with the one by default in Ubuntu.  pep8 and pylint are happy for the two files modified in these changes.

Looks good. Thanks for contributing this enhancement.


[NETBEANS-1147] Better enablement of fragment modules.

Inspired by #715 change with additional tests provided.
Originally the branch should only add tests, but as it showed up, some corner cases were not handled (I think) still well.
I wanted to cover 3 cases:

the user enables a module which is a fragment; which should imply enabling the host module as well. 2.  if the user enables the hosting module which just happens to have some fragments around, all those will be enabled and injected (if dependencies are satisfied)
if a fragment is enabled, but its host module is already loaded and live, the fragment cannot (reliably) join the constructed classloader. Exception should be thrown.

I found a place in AutoupdateCatalogParser where the needsRestart condition is probably wrong: if the module is a fragment, then the restart is always needed. Maybe could be refined more in that the host module must be already installed & enabled.

in original code, the fragments were registered at the start of ModuleManager.enable, so that simulateEnable would not report them. I changed that so ModuleManager collects fragment list immediately as fragment Module objects are created. Then it can always find all fragments for a module.

rebased on latest master merged with other changes in o.n.bootstrap


Fail to create a container app with the default Express image name

OS: All
Build Version: 20230329.6
Repro Steps:

Open an Express project in VS Code which includes Dockerfile in it.
Right click one container app environment -> Select "Create Container App... -> Enter a container app name -> "Select "Build from project remotely using Azure Container Registry" -> Select an Azure Container Registry -> Select the default "Dockerfile" in the project folder -> Use the default express image name and fill the following steps to create a container app.

Check whether succeeds to create a container app or not.

Expect:
Succeed to create a container app with the default image name.
Actual:
Fail to create a container app with the default image name.

More Info:

This issue does not reproduce when creating container app with the default MVC/Django image name.
Succeed to create a container app with the name "myExpress or myExpress:latest".

For now this error is specific enough that users should be able to workaround it if encountered.
From our discussion in triage it seems like we need to investigate how this value is used and if we need to ask users for it at all.


Localization & Table Recognition

As I've been working with your software, I've come across a couple of questions that I hope you might be able to help with:

Language Localization: Is it possible to add or modify the language localization to recognize tables in a different language? This feature would greatly enhance the usability of the tool for diverse user groups, including those who work with non-English datasets.

Table Recognition: I've noticed that not all tables in images are being detected by the software. Would it be feasible to adjust the threshold values for table detection? I understand that the current version uses a basic model trained on TATR. I'm interested in knowing whether it's possible to replace this with a custom model, trained in a similar manner on TATR but on our own datasets. This customization could potentially improve the tool's performance for specific use cases.

Thank you in advance for your reply.

Hi @PashaGV, thank you for your feedback.
#1. Table Hyper Parameter tuning:
This is partially possible, we have values that you can play with, these are the thresholds for Table, Column and Row recognition. At the moment they can be found in two places.
Table sensitivity can be found in TableDetector.py in line 89 of the runTATR() method:
results = image_processor.post_process_object_detection(outputs, threshold=0.9, target_sizes=target_sizes)[0]
#you can modify the `thershold=0.9` as you wish

On the other hand, Column- and Row-sensitivity can be found in the StructureDetector.py-file on lines 174 to 176
if not (label == 1 and score <= .88) and \ #columns
not (label == 2 and score <= .64) and \ #rows

I will change this in the future so that you dont need to get into the sourcecode to get this to work. I will make it into a variable that you can call immediately from the extractable.extract() function. I expect this to be created in a 2 weeks from now.
#2. Language Localization:
I am unsure of how this could be implemented, if it would require the retraining of the underlying TATR model. I refer you to question #3
#3. Table training/custom model
Yes! it is possible to train and customize the model and also to use different models than TATR. But you will have to build the code for it yourself. Or make a specific request of which model you would like added to extractable and why. If you make it yourself feel free to make a pull request to get your code reviewed and published in the extractable library.
Here is a leg up though;
If you look op on huggingface there are other TATR models available that are further trained by people; https://huggingface.co/models?sort=trending&search=tatr-

You can check how they did it and do it yourself too.
Then you can open a branch from this (extractable) github repository. And add a class similar to TableDetectorTATR or TableDetectorDETR in the TableDetector.py module., for example TableDetectorTATRPashaGV. in the functions you can basically copy the code from the TableDetectorTATR class, and just change the lines 30 and 31:
image_processor = AutoImageProcessor.from_pretrained("microsoft/table-transformer-detection")
model = TableTransformerForObjectDetection.from_pretrained("microsoft/table-transformer-detection")

#replace "microsoft/table-transformer-detection" with your own for example:
image_processor = AutoImageProcessor.from_pretrained("vivekjain14/tatr-finetuned-checkpoint01")
model = AutoModelForObjectDetection.from_pretrained("vivekjain14/tatr-finetuned-checkpoint01")

Then, to connect this tabledetector to the rest of extractable (image conversion, structuredetection, textextraction, xml writing) you can go to the Extractor.py module and add a function similar to extract_using_TATR(). for example:
extract_using_TATRPashaGV(input_file: str, output_dir: str, output_filetype: Filetype = Filetype.XML, mode:Mode = Mode.PERFORMANCE):
    if mode == Mode.DEBUG:
        logger.setLevel(logging.INFO)

    pipeline = compose_left(
            TableDetector.TableDetectorTATRPashaGV.process,            # ---> Make sure you replace this into your tabledetector
            StructureDetector.StructureRecognitionTATR.process,
            TextExtractor.PyPDF2Textport.process,
            DataObj.output)

    if input_file.endswith('.pdf'):
        pipeline = compose_left(PDFtoImageConvertor.ConvertUsingPDF2image.process,
                                pipeline)

    # create a data_object which will be passed into pipeline of all classes
    data_object = DataObj(input_file=input_file, output_dir=output_dir, output_filetype=output_filetype, mode=mode)

    # run the pipeline on data_object
    pipeline(data_object)

    logger.info('✔ Process Finished', extra={'className': 'Extractor'})

    return data_object

And thats it!
Now you can call extractable.extract_using_TATRPashaGV(input_file, output_dir) and you should get the same functionality but with your own custom module.


feat(model): Extend Identifier.toPurl() with handling for Bazel

See also 1.

See also 1.

While that PR is not merged yet, we're not making any explicit assumptions about it in here, so we should be good to go.


New version: WhatPulse.WhatPulse version 5.8.2

Checklist for Pull Requests

[x] Have you signed the Contributor License Agreement?
[ x ] Is there a linked Issue?

Manifests

[ x ] Have you checked that there aren't other open pull requests for the same manifest update/change?
[ x ] This PR only modifies one (1) manifest
[ x ] Have you validated your manifest locally with winget validate --manifest <path>?
[ x ] Have you tested your manifest locally with winget install --manifest <path>?
[ x ] Does your manifest conform to the 1.9 schema?

Note: <path> is the directory's name containing the manifest you're submitting.

fixes #197206
Microsoft Reviewers: Open in CodeFlow

@microsoft-github-policy-service agree [company="WhatPulse"]

@microsoft-github-policy-service I don't know how to debug this, as the validation output isn't saying anything, except an empty response and Result: Failed
this PR works in several Windows installs, and I've run all tests beforehand (SandboxTest.ps1, winget validate & install), how do I ask someone for help?

@stephengillie just seeing you're attached to this PR as well as the bot, hope you can help? How do I find out what's causing the validation to fail?
Thanks!


File Descriptor in bad state

Hello I have nexus 7 pro with net hunter and I got this error can u suggest what is the problem?

I also ran into this problem, did you solve it?

I found that the problem was because the android is patched, I just try on older version and works perfect...


MERGE DEC. 8 - Update Service Worker post to use CLP instead of Lock

Consolidated into https://github.com/auth0/blog/pull/1214


Feature Users schemas

created module schemas
installed pydantic email-validator and its dependencies
created pydantic schemas (UserBase, UserCreate, UserUpdate, UserDB)
added test for all schemas

Codecov Report

Merging #13 (25d0544) into master (7d4316c) will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##            master       #13   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            7         9    +2
  Lines           53        74   +21
  Branches         1         1
=========================================
+ Hits            53        74   +21

Impacted Files
Coverage Δ

schemas/__init__.py
100.00% <100.00%> (ø)

schemas/users.py
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7d4316c...25d0544. Read the comment docs.


Not getting any more posts, ending scrolling before limit

I use Windows 10 Home and I have python 3.7 installed.
If I run on cmd py -3.7 crawl_profile.py danbilzerian I get the following:
DevTools listening on ws://<IP_ADDRESS>:51160/devtools/browser/5a390a57-f73b-4933-b2eb-614fd7b190c7
Extracting information from danbilzerian
INFO [2019-12-09 00:26:58] Extracting information from danbilzerian
INFO [2019-12-09 00:27:01] Alias name: Dan Bilzerian
INFO [2019-12-09 00:27:01] Bio: Content for 21+
Snapchat: dbilzerian
INFO [2019-12-09 00:27:01] Url: ignitecbd.co
INFO [2019-12-09 00:27:01] Posts: {'count': 1344}
INFO [2019-12-09 00:27:01] Follower: 29347018
INFO [2019-12-09 00:27:01] Following: {'count': 330}
INFO [2019-12-09 00:27:01] Is private: False
0
9
INFO [2019-12-09 00:27:11] breaking in 3...
If you believe this is only caused by slow internet, increase sleep time 'sleep_time_between_post_scroll' in settings.py
9
INFO [2019-12-09 00:27:16] breaking in 2...
If you believe this is only caused by slow internet, increase sleep time 'sleep_time_between_post_scroll' in settings.py
9
INFO [2019-12-09 00:27:21] breaking in 1...
If you believe this is only caused by slow internet, increase sleep time 'sleep_time_between_post_scroll' in settings.py
9
INFO [2019-12-09 00:27:26] breaking in 0...
If you believe this is only caused by slow internet, increase sleep time 'sleep_time_between_post_scroll' in settings.py
INFO [2019-12-09 00:27:26] Not getting any more posts, ending scrolling
INFO [2019-12-09 00:27:28] User danbilzerian has 0 comments.
Number of users who commented on their profile is  0

C:\Users\Daniel\instagram-profilecrawl\profiles\danbilzerian_commenters_2019-12-09 00-27-28.txt

Finished. The json file and nicknames of users who commented were saved in profiles direct

I am able to get the JSON file but only with the first posts from the profile. I tried that process with other profiles and I had the same problem. I was expecting information about much more posts since I set the settings.py file as below:
import os
from sys import platform as p_os

BASE_DIR = os.path.dirname(os.path.dirname(os.path.abspath(__file__)))
OS_ENV = "windows" if p_os == "win32" else "osx" if p_os == "darwin" else "linux"

class Settings:
    profile_location = os.path.join(BASE_DIR, 'profiles')
    profile_commentors_location = os.path.join(BASE_DIR, 'profiles')
    profile_file_with_timestamp = True
    profile_commentors_file_with_timestamp = True
    limit_amount = 100
    scrape_posts_infos = True
    scrape_posts_likers = True
    scrape_follower = False
    output_comments = False
    sleep_time_between_post_scroll = 5
    sleep_time_between_comment_loading = 5
    mentions = True

    log_output_toconsole = True
    log_output_tofile = True
    log_file_per_run = False
    log_location = os.path.join(BASE_DIR, 'logs')

    #from Instpy
    # Set a logger cache outside object to avoid re-instantiation issues
    loggers = {}

    login_username = ''
    login_password = ''

    #chromedriver
    chromedriver_min_version = 2.36
    specific_chromedriver = f"chromedriver_{OS_ENV}"
    chromedriver_location = os.path.join(BASE_DIR, "assets", specific_chromedriver)

    if not os.path.exists(chromedriver_location):
        chromedriver_location = os.path.join(BASE_DIR, 'assets', 'chromedriver')

It seems like the scroll process on extractor.py is not working properly, but I am really not sure. How should I proceed?
Thank you for this awesome library!

Hi, I am encountering the same issue. Did you manage to resolve it? If yes, how?


persist and report container grace time

This should satisfy https://www.pivotaltracker.com/story/show/116986065.
Haven't added a GQT yet as I'm not sure there's a great way to test this kind of thing without introducing either flakiness or slowness (plus the actual logic for that lives in garden anyway).

Hi there!
We use Pivotal Tracker to provide visibility into what our team is working on. A story for this issue has been automatically created.
The current status is as follows:

[ ] #117402133 persist and report container grace time

This comment, as well as the labels on the issue, will be automatically updated as the status in Tracker changes.

Merged! Gracias!


FEATURE: auto-build a docker image

Objective of this new feature: propose an automatically built Docker image
Benefits:

very simple (aka easy to review or maintain) build script
light (280MB vs 2GB with the current available images)
simple architecture (1 docker = 1 service)
auto-build a latest tagged image when something is pushed on branch 1.9
auto-build a version tagged image when a new git tag is created (or some tags only by using a regexp)

The two last points are only available when the Dockerfile is part of the source code when using the autobuild feature of the dockerhub platform.
This is the using Dockerfile I'm using currently. This Dockerfile is not the one to be merged, it has an extra step which is the git clone (step already done by the CI tool usually)
FROM microsoft/dotnet:2.1-sdk-alpine AS build

ENV TAG=1.9

RUN set -ex; \
    apk add --no-cache git; \
    git clone -b "$TAG" https://github.com/LordVeovis/NadekoBot

WORKDIR /NadekoBot/src/NadekoBot
RUN set -ex; \
    dotnet restore; \
    dotnet build -c Release; \
    dotnet publish -c Release -o /app

WORKDIR /app
RUN set -ex; \
    rm libopus.so libsodium.dll libsodium.so opus.dll; \
    find . -type f -exec chmod -x {} \;; \
    rm -R runtimes/win* runtimes/osx* runtimes/linux-*

FROM microsoft/dotnet:2.1-runtime-alpine AS runtime
WORKDIR /app
COPY --from=build /app /app
RUN set -ex;\
    apk add --no-cache \
        ffmpeg \
        youtube-dl \
        libsodium \
        opus; \
    adduser -D nadeko; \
    chown nadeko /app; \
    chmod u+w /app; \
    install -d -o nadeko -g nadeko -m 755 /app/data

# workaround for the runtime to find the native libs loaded through DllImport
RUN set -ex; \
    ln -s /usr/lib/libopus.so.0 /app/libopus.so; \
    ln -s /usr/lib/libsodium.so.23 /app/libsodium.so

VOLUME [ "/app/data" ]
USER nadeko
CMD ["dotnet", "/app/NadekoBot.dll"]

And the docker-compose.yml to run the Nadeko stack:
version: "3.5"
services:
  nadeko:
    #image: willysunny/nadecker:latest
    build: .
    depends_on:
      - redis
    restart: unless-stopped
    environment:
      TZ: Europe/Paris
    volumes:
      - /docker/nadeko/conf/credentials.json:/app/credentials.json:ro
      - /docker/nadeko/data:/app/data

  redis:
    image: redis:alpine
    sysctls:
      net.core.somaxconn: 511

NSFW and Music, the most important feature of Nadeko ;), seems to work.
A little detail remains: I don't know the equivalent of LD_LIBRARY_PATH for .netcore2, if such a thing exists (https://github.com/dotnet/coreclr/issues/930)
As a note: the files in /app/data MUST be owned by the user 1000 (nadeko inside the container)

Cheers, I based my own on yours: https://hub.docker.com/r/chauffer/nadekobot/~/dockerfile/ 👍

🤐 You guys are awesome. I'm just a pleb for you.

Hey @LordVeovis, getting this, tried to troubleshoot it but to no avail:
09/09/2018 01:51:44-1 23:51:44 ShardsCoordinator | Starting shard 0, 0 more in queue.
09/09/2018 01:51:44Did you mean to run dotnet SDK commands? Please install dotnet SDK from:
09/09/2018 01:51:44  http://go.microsoft.com/fwlink/?LinkID=798306&clcid=0x409

do you know what could cause it?

@chauffer well done, I forgot to put this part of my config file.
@Kwoth I suspect the "dotnet NadekoBot.dll" will also work on windows, so maybe it's possible to remove the condition on the ShardRunCommand when not set. I have to dig...
I'm preparing the PR :)


Mopidy 1.0 compat

Mopidy 1.0 has been released. This is an untested shot at getting Mopidy-AudioAddict working with the changed backend APIs in Mopidy 1.0.
See https://docs.mopidy.com/en/latest/changelog/#v1-0-0-2015-03-25 for details.

Awesome, thanks!

Any progress on this? Would be great to have a Mopidy-AudioAddict release working with Mopidy 1.x.


feat: use asyncio

Codecov Report

Merging #106 (de2917a) into main (b2ebb0e) will increase coverage by 5.42%.
The diff coverage is 45.09%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
@@            Coverage Diff             @@
##             main     #106      +/-   ##
==========================================
+ Coverage   49.00%   54.43%   +5.42%
==========================================
  Files           5        5
  Lines         251      237      -14
==========================================
+ Hits          123      129       +6
+ Misses        128      108      -20

Impacted Files
Coverage Δ

src/images_upload_cli/upload.py
28.16% <35.71%> (+3.16%)
:arrow_up:

src/images_upload_cli/cli.py
92.30% <88.23%> (-1.25%)
:arrow_down:

src/images_upload_cli/__init__.py
100.00% <100.00%> (ø)


add support for json serialziation of cluster objects

Cloud config is often written in yaml but go-pluggable and c3os do most of their serialization in json.  This was causing the config section of the cluster config to be lost.  I added support for serializing cluster objects as json and yaml.

Codecov Report

Merging #89 (e1c7406) into master (209db95) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #89   +/-   ##
=======================================
  Coverage   41.34%   41.34%
=======================================
  Files           5        5
  Lines         445      445
=======================================
  Hits          184      184
  Misses        239      239
  Partials       22       22

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Different results pydlm vs dlm package (in R)

I get different results in an extremely simple dynamic linear model, using dlm package in R and pydlm.
In particular, I create a random walk + noise dlm (that is dlm with just a trend of degree 0 or 1, depending on the version of the pydlm package). I fix the discount factor to be 1, that is W_t = 0 for all t (that is, the variance of the noise of the state evolution equation is null). The noisePrior is 1.0 by default. I fix the prior variance to be 2.0. I include just one observation: 1.70. With this I build the dlm:
Here the code:
from pydlm import *
d = dlm([1.70])
t = trend(degree = 0, discount=1, w = 2)
d = d + t
d.fitForwardFilter()
print(d.getLatentState())
[[1.1333333333333333]]
print(d.getLatentCov())
[matrix([[ 0.65444444]])]
Doing the same in R, I obtain the same latent state, but different state covariance. Particularly I obtain 0.666666.
In fact, performing the calculations by hand, I obtain the same as in R. This is quite easy to reproduce, following the formulas in page 53 of this book: Dynamic Linear Models with R,  Giovanni Petris, Sonia Petrone, Patrizia Campagnoli.
Am I misunderstanding the meaning of some parameter?

Hi roinaveiro,
Thanks for raising this issue. Your understanding is correct, but do note that the underlying assumption is different here between pydlm and the R code.
Based on Page 53 of the book, what the R code doing is similar to pydlm with a key difference that it assumes the observation noise (v_t) is fixed to be 1. While in pydlm, the observation noise (noisePrior) is initialized at 1 but then it will be learned from the data and changing over time (You can tell this from the parameter name). Therefore, the result you get from R will be different from pydlm due to this self-learning property.
One way to get a consistent result using pydlm is to just fix the observation noise or set the initial confidence on the noisePrior to be high so the noise value won't get updated. However, this parameter is current not exposed to the user. Please do let me know if you think it is an important feature to you (i.e., tell the model not to learn observational noise from the data).
Thanks!


A message that you sent could not be delivered to one or more of its
recipients. This is a temporary error. The following address(es) deferred:
<EMAIL_ADDRESS>Domain rtfs.hu has exceeded the max emails per hour (153/150 (102%)) allowed.  Message will be reattempted later
------- This is a copy of the message, including all the headers. ------
Received: from o1.sgmail.github.com ([<IP_ADDRESS>]:41690)
by cp5.ezit.hu with esmtps (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128)
(Exim 4.88)
(envelope-from<EMAIL_ADDRESS>id 1csDbM-001vXq-FP
for<EMAIL_ADDRESS>Sun, 26 Mar 2017 21:13:20 +0200
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=github.com;
h=from:reply-to:to:cc:in-reply-to:references:subject:mime-version:content-type:content-transfer-encoding:list-id:list-archive:list-post:list-unsubscribe;
s=s20150108; bh=AwlhtXmICU/W979w6DNIl3Ncopc=; b=Z1cttlGhwjHCs7gL
kobrxuDgYVBeUFUQt4SBAIbCPITOEibfCIdWEcESF6l33BwIDwGWFVr5MikSGOzJ
QtQiSaNDPwwmi4wdUvEOklpGRhCz4efrgIslfOHCIX4pAtiqorEx30qe4QCfmdoN
AbgxdVKHNoTe8XhHrx09wtWI6bg=
Received: by filter0498p1mdw1.sendgrid.net with SMTP id filter0498p1mdw1-28135-58D81287-7
2017-03-26 19:12:07.109390162 +0000 UTC
Received: from github-smtp2a-ext-cp1-prd.iad.github.net (github-smtp2a-ext-cp1-prd.iad.github.net [<IP_ADDRESS>])
by ismtpd0003p1iad1.sendgrid.net (SG) with ESMTP id Z7ZY7Y9IT7uIbezRptaWig
for<EMAIL_ADDRESS>Sun, 26 Mar 2017 19:12:07.101 +0000 (UTC)
Date: Sun, 26 Mar 2017 12:12:07 -0700
From: Martin Holst Swende<EMAIL_ADDRESS>Reply-To: ethereum/remix<EMAIL_ADDRESS>To: ethereum/remix<EMAIL_ADDRESS>Cc: Subscribed<EMAIL_ADDRESS>Message-ID<EMAIL_ADDRESS>In-Reply-To<EMAIL_ADDRESS>References<EMAIL_ADDRESS>Subject: Re: [ethereum/remix] zelig is too fat to fit outside (#229)
Mime-Version: 1.0
Content-Type: multipart/alternative;
boundary="--==_mimepart_58d812872621_42283f8750a5fc3c2147e6";
charset=UTF-8
Content-Transfer-Encoding: 7bit
Precedence: list
X-GitHub-Sender: holiman
X-GitHub-Recipient: axic
X-GitHub-Reason: subscribed
List-ID: ethereum/remix <remix.ethereum.github.com>
List-Archive: https://github.com/ethereum/remix
List-Post<EMAIL_ADDRESS>List-Unsubscribe<EMAIL_ADDRESS>https://github.com/notifications/unsubscribe/AABPdAnELQ3RPz67mo9L8EzlCg0y1Ssoks5rpriGgaJpZM4MphmL
X-Auto-Response-Suppress: All
X-GitHub-Recipient-Address<EMAIL_ADDRESS>X-SG-EID: he4tc8JlxDVCj/mAHwwgsMtcJA8qPMNBei4OutdBlY4tXnl1azy4ON7LeciGujYAvqfnDKHpksFHcr
ZceRaGlqjK02aLRljjoZpVAxZK/2NbDmcp9xSXt5thiRgBOCVEPzffzpxvf4fNrxSk+GrGX8K1PECw
VoegBglbhj7iEvVMkILkwXNShJDg9A6cbej3NaNuT39OhwbwwzUAnL4rOR/dejYJiRZhj6RKtjE1RF
o=
----==_mimepart_58d812872621_42283f8750a5fc3c2147e6
Content-Type: text/plain;
charset=UTF-8
Content-Transfer-Encoding: 7bit
Closed #229.
--
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/ethereum/remix/issues/229#event-1015781940
----==_mimepart_58d812872621_42283f8750a5fc3c2147e6
Content-Type: text/html;
charset=UTF-8
Content-Transfer-Encoding: 7bit
Closed #229.
—You are receiving this because you are subscribed to this thread.Reply to this email directly, view it on GitHub, or mute the thread.

----==_mimepart_58d812872621_42283f8750a5fc3c2147e6--


Add a star indicator in Hydra Lab web portal

https://buttons.github.io/

#253 Working on it.

This is done, thanks @RaccoonLi for the help.


Parser

Integrating new parser with mathsteps

added parser support for basic rules
includes Kevin's initial porting branch

Context:
This PR disables almost all of the existing tests except for the ones that are passing. Note that the tests themselves have not been changed.
The plan is to build upon this foundation with a series of small PRs to add parser support for our existing rules.

is everything on here stuff that was already code reviewed? I was assuming parser would be open for a while and we'd review things as they go into the branch with pull requests (like the porting branch)
what do you think?

Yeah, a majority of this code has already been reviewed by you. Mostly Kevin's code and then I added parser support for all of the basic rules. Keep in mind that we are not working with math-rules at all in this branch.

I'd much prefer if you could:

put kevin's code as it was, on this branch
open a pull request of you unreviewed code against this branch so it can be reviewed
keep opening pull requests against this branch going forward for math-parser

otherwise it's hard to keep all the code reviewed (which I think is pretty important)
let me know if you have questions/issues with that

Reverted my own commit so this branch only contains Kevin's code. I will issue another PR against this branch with my changes.

I think it could make sense to move #176 here then (or we can keep it separate if that's easier)

I'll make the changes along with my next PR since the changes are pretty small.

if Lili requests changes on this PR will you make them here though? Or is this PR just to show the diff and not for any review changes

Can you mark this PR as "DO NOT MERGE"?


gccgo: very long gcbits symbol names

gccgo is generated gcbits symbols with their full name, instead of hidding them under gcbits..* like Go toolchain is doing (cf https://go-review.googlesource.com/c/go/+/12531/).
Corresponding Go issue #11583
$ nm index0-out.o | grep gcbits
...
gcbits..bazaaaaaaaamaaa... (average 100 000 a... )
...

On AIX, symbol names are limited to 65535 characters.
Therefore, test "./index0-out.go compilation" is failing:
ld: 0711-950 ERROR: A name is too long.
        Names longer than 65535 characters are truncated.
        The name begins: gcbits..bazaaaaaaaamaaaaaaaaaaaaaaaaaaaaaaaaa
ld: 0711-950 ERROR: A name is too long.
        Names longer than 65535 characters are truncated.
        The name begins: gcbits..bazaaaaaaaamaaaaaaaaaaaaaaaaaaaaaaaaa
collect2: error: ld returned 8 exit status
compiler exited with status 1

Is there any way to reduce/hide these symbol names as it's done under Go toolchain ?
I don't think such thing can actually occur in a "real" Go code, but that might be worth fixing it once for all.
/cc @ianlancetaylor  @thanm

Could you please post the code in question, or some sort of source reproducer? Thanks.

index0-out.zip
This index0-out.go is generated inside gccgo testsuite (under gcc/testsuite/go.test/test) by index0.go and index.go.


make the method cleaner and also short

I think this is the best of both worlds
its readable and it uses ternary

Looks good to me

Sweet


add --external option to open

Allow user to use a configured external domain when calling $ powder open.
powder open currently defaults to the first configured POW_DOMAIN, but there is no way to open a configured POW_EXT_DOMAIN besides xip.io. This allows a user to configure a different external domain (e.g., one that always resolves to <IP_ADDRESS>), and open the application using powder.
for example, you can add
export POW_EXT_DOMAINS=vcap.me,xip.io

to your .powconfig, then call $ powder open -e to open your app to my_cool_app.vcap.me.

I have a similar use case and have been hoping this sort of feature would be added :exclamation:

+1

any update on this? @rodreegez


Uploads fails to immutable fileset

Environment info

NooBaa Version: 5.15.4-20240704.el8.x86_64
Platform: Storage Scale <IP_ADDRESS> / RHEL8 / x86-64

Actual behavior

When trying to upload objects to an immutable fileset, it fails with error account AccessDenied.

Expected behavior

Uploads should succeed.

Steps to reproduce
# mms3 account create s3account --uid 1001 --gid 1001 --newBucketsPath "/ibm/fs1/s3account/"

Account s3account created successfully
 Access Key             Secret Key
 ---------              ----------
w0wDKyXu4jDvXWnwNIL1    dZ+lHgLJ8F0mNgnGvFpQtQTkAO9X5BviEUrAXvuy

# mmcrfileset fs1 immutable --inode-space new
# mmchfileset fs1 immutable --iam-mode noncompliant
# mmlinkfileset fs1 immutable -J /ibm/fs1/immutable
# chown 1001:1001 /ibm/fs1/immutable
# mms3 bucket create immutable --accountName s3account --filesystemPath /ibm/fs1/immutable

# aws --no-verify-ssl  --endpoint-url='https://<IP_ADDRESS>:6443' s3 cp /etc/passwd s3://immutable
upload failed: ../etc/passwd to s3://immutable/passwd An error occurred (AccessDenied) when calling the PutObject operation: Access Denied

More information - Screenshots / Logs / Other output
This is most likely caused how the file is created or renamed after upload. If we point GPFSDLPATH  to a non-existent path (to disable the libgpfs.so integration), then the uploads work. I suspect the problem is either that O_TMPFILE doesn't work with immutable fileset, or that the uploaded file is created with too strict permissions initially -- which would trigger it to become immutable, and that it then fails to relink to the final destination.
GPFS immutability is automatically enabled for a file if we remove write access:
# touch testfile
# ls -l testfile
-rw-r--r--. 1 root          root             0 Aug 30 16:31 testfile
# mmlsattr -L testfile |grep -i immu
immutable:            no

# chmod u-w testfile
 mmlsattr -L testfile |grep -i immu
immutable:            yes

I suspect it's this functionality that's kicking in during the linking of the O_TMPFILE somehow..
Additionally, I tested keeping the top-level .noobaa-nsfs directory on a non-immutable fileset, and just having the directory we uploaded to be an immutable directory one level further down, but this also failed the same way. So it's not the .noobaa-nsfs tmp-files that's causing the access denied.

It fails for simple put, and also for multipart uploads. With multipart uploads, all the parts are successfully uploaded, but then fails at the CompleteMultipartUpload operation.
upload failed: ../../../../root/Storage_Scale_Data_Management-<IP_ADDRESS>-x86_64-Linux-install to s3://immutable/Storage_Scale_Data_Management-<IP_ADDRESS>-x86_64-Linux-install An error occurred (AccessDenied) when calling the CompleteMultipartUpload operation: Access Denied

I made a simple gpfs_linkat test.. and it seems this fails on immutable filesets. It's not documented to not work for immutable filesets, so I think this must have been a bug/oversight..

#define _GNU_SOURCE
#include <fcntl.h>
#include <unistd.h>
#include <stdio.h>
#include <stdlib.h>
#include <errno.h>
#include <string.h>
#include <limits.h>
#include <gpfs.h>

// # int gpfs_linkat(gpfs_file_t olddirfd, const char *oldpath,
// #                 gpfs_file_t newdirfd, const char *newpath, int flags);

int main(int argc, char* argv[]) {
    const char *dirpath = argv[1];
    const char *filename = "linked_tempfile.txt";

    // Create a temporary file with O_TMPFILE
    int fd = open(dirpath, O_TMPFILE | O_RDWR | O_EXCL, 0600);
    if (fd == -1) {
        perror("Failed to create O_TMPFILE");
        return EXIT_FAILURE;
    }

    // Write some data to the temporary file
    const char *data = "Hello, world!";
    if (write(fd, data, strlen(data)) == -1) {
        perror("Failed to write to the temporary file");
        close(fd);
        return EXIT_FAILURE;
    }

    // Link the temporary file to a name
    char tmpname[PATH_MAX];
    snprintf(tmpname, sizeof(tmpname), "%s/%s", dirpath, filename);

    if (gpfs_linkat(fd, "", AT_FDCWD, tmpname, AT_EMPTY_PATH) == -1) {
        perror("Failed to link the temporary file");
        close(fd);
        return EXIT_FAILURE;
    }

    printf("Temporary file linked to: %s\n", tmpname);

    close(fd);

    return EXIT_SUCCESS;
}

# mmcrfileset fs1 immutable --inode-space new
# mmchfileset fs1 immutable --iam-mode noncompliant
# mmlinkfileset fs1 immutable -J /ibm/fs1/immutable

# mmcrfileset fs1 nonimmutable --inode-space new
# mmlinkfileset fs1 nonimmutable -J /ibm/fs1/nonimmutable

# gcc -o gpfsLinkTmpfile gpfsLinkTmpfile.c  -l gpfs -L /usr/lpp/mmfs/lib/
# ./gpfsLinkTmpfile /ibm/fs1/nonimmutable
Temporary file linked to: /ibm/fs1/nonimmutable/linked_tempfile.txt
# ./gpfsLinkTmpfile /ibm/fs1/immutable
Failed to link the temporary file: Operation not permitted

@janfrode thanks for opening this bug.
I would expect an InternalError with operation not permitted, Can you attach the logs (debug level 5) or send them on Slack? message and not access denied..
@eshelmarc is this failure of linkat() on immutable filesystems is expected or has a bug?

I've opened an internal issue for this with Scale-development. Seems clear that it's a bug in the gpfs_linkat() call.

Thanks @janfrode
So i'm closing this issue for now, feel free to re-open it if needed

@janfrode , could you pass on the GPFS bug, We get EPERM when we try to enable the fileset with the --iam-mode
Nov 20 16:19:02 gpfs1 [264410]: [nsfs/264410] ^[[33m [WARN]^[[39m core.sdk.namespace_fs:: NamespaceFS: upload_object buffer pool cleanup error [Error: Operation not permitted] { code: ^[[32m'EPERM'^[[39m }

defect RTC-336905


Artificial General Intelligence (AGI) – General Discussion, Resources Etc.

Links
https://github.com/Twenkid/Artificial-General-Intelligence-AGI
https://github.com/Twenkid/izkustven-razum-i-razvitie-na-choveka-kniga
https://discourse.numenta.org/
https://discourse.numenta.org/t/is-billions-of-parameters-or-more-the-only-solution/10384/101
https://discourse.numenta.org/t/nn-centroid-clustering-search/10443/7?fbclid=IwAR09pqQGhacybV2ORKtftWpQr9XFr3r0ypbQcuCMyyP26YzEWmUK6ItUZ4Y

LLM as search engines, Transformers as big hierarchical maps/dictionaries/hash tables etc.
A discussion on a Numenta's forum regarding the LLM as search engines etc.:
https://discourse.numenta.org/t/nn-centroid-clustering-search/
https://discourse.numenta.org/t/is-billions-of-parameters-or-more-the-only-solution/10384/107
The links were from a discussion with Boris Kazachenko, who is arguing that NN are doing centroid clustering. He is the creator of the CogAlg project (originally "Cognitive Algorithm"), of which I coined that shorthand title "CogAlg" in an email back in 2010 and it was adopted in mid-late 2010s as the name in Github when the project started to get developed in code. https://github.com/boris-kz/CogAlg
The popularity of ChatGPT and GPT3 used for all kinds of queries suggeted that.
A few thoughts from me from a discussion about CogAlg on 20.2:
https://github.com/boris-kz/CogAlg/blob/master/frame_2D_alg/Illustrations/generic graph.drawio.png

Todor: An interpretation and association, from my POV and own understanding of some general cognitive processes: that may be (building, an element for building) a graph that is tracing a chain of matches/mapping. [Regarding a CogAlg "Cognitive Node" and graphs. Well, this is a generality.]
One of the core abstract structure and process of intelligence is the mapping between different representation[s] and coordinates and the sequence of mappings in between the path, train of thought, chain of intermediate/incremental representations, like the "associative thinking" in more high level view of human cognition.
Clustering, connectivity clustering in general are also about that.
The above is present in ANN in transformers as well, where transformers look like huge and complex multilevel, multi range, multi step maps/hash tables - they even have Query/Key/Value in their definitions and terminology.
Also I'd probably prefer a term like "cognitive element" instead of "neuron", although the growing of axons and dendrites, vertices and nodes of the graph, may make a good analogy with the real neurons and possibly it is not bad a term for that reason.
(...)
Re transformers - ... I meant an abstract essence of their function, application; not the way they build the representation used to execute the function or that they are doing it exactly as you do.
One thing that they do though is hierarchically finding the correlation between adjacent input elements in sequences of bigger ranges, a bigger regions of adjacent tokens.
Also for now I don't know how the "tokens" in the transformers -- possibly RNN's inputs as well -- map to your scheme.
Is there a counterpart to transofmers'/RNN's "tokens"/token-dictionary in your algorithm?
I can assume the lowest level patterns could serve for such tokens, or some set of them with some "limited" properties (a complexity measure, number of patterns etc. which fit in a given memory limitation etc. - at least that's what I'd do).
The first levels build the most basic dictionary of the patterns which are encountered first and fall within a certain complexity range, however each level has dictionaries and  such ranges, and possibly part of the "grammar" is inter-level, it may "spill" between the levels.
(Well, sure this is too abstract without working with precise patterns and structures.)
B: Right, this is a hierarchical graph, with multiple composition levels
B: In terms of results, transformers do learn graphs, through positional encoding. Key-value pairs are links/edges. But the main question is how they learn them, which is totally different.
B: Nothing in NNs is similar in terms of core learning process: they do centroid-based clustering:
comparison-last, I do connectivity-based: comparison-first. That's the main point. Dictionaries, grammar: these are all language-inspired distractions.
B: Related discussion: https://discourse.numenta.org/t/nn-centroid-clustering-search/10443/28
T: The set of same-level patterns with the patterns to which they are connected are a map, or "a dictionary". The set and connections in all senses that this could be defined in your algorithm: "above average match" etc., adjacency (all adjacent to some anchor), all-miss; edge-patterns, "background"-patterns/negative/positive (sorry I'm not familiar with the details  of the current state of the system)
A "dictionary" or map is mathematical, a function, a set of mappings.
A grammar is the set of rules for comparison and creating new nodes, graphs, links - that's the algorithm which builds the graph.
T: Thanks for the new picture, the first one was transparent and had issues when clicked.
Can you elaborate what's the difference between range-match and extended match?
B: There is no need for these terms, they only make things look more complicated.
Same thing, just more suggestive. It means match over incremented comparison range.
It's a rng+ vs der+ fork in sub_recursion_g: https://github.com/boris-kz/CogAlg/blob/master/frame_2D_alg/agg_recursion.py


Update to Symfony 4.4.13 or higher

Bumping Symfony dependencies.
The version string >=4.4.13 <5.0 might not be ideal, so I'm hoping to get some 👀  on it ...

Simply changing ^4.1 to ^4.4.13 will give the same outcome, as 5.x is a major-release over 4.x in semver and therefore blocked by ^4.x.y patterns.


Fix various item previews on the sheets not displaying enriched HTML …

…(such as journal entries not being linked)

Fixes issue #247


Sc163454 acknowledge policy changes banner

Summary:

What: Adds a banner that notifies user of policy changes, along with a way to track user acknowledgment of those changes.
Ticket: sc<163454> & sc<164302>
Env: https://chicagoui-frontend.dev.genepi.czi.technology

Demos:
(Edit: whoops, took screenshots and pushed rdev before I remembered to move from "September XX" to "September 30". Will update rdev right now, should be in place by 11:30am)
How it looks in wide (normal) window

How it looks in narrow window (with text wrapping)

Notes:
Some conditionality on when the banner displays:

User must be logged in. Discussed with Olivia on Slack: we won't show the banner to anonymous visitors since they aren't necessarily app users who would need to agree to terms, etc or be made aware of changes.
With above in mind, even if a user is logged in, we only display the banner if they have accepted the Terms of Service (that way we don't simultaneously display the Terms of Service pop-up and the "new policies!" banner running along the top)
Closing the banner is considered acknowledgment of the changes and will prevent the banner from appearing from there on out (or at least until the next time we need to change policies).

Other things:

Agreeing to the ToS is also considered an acknowledgment of the current set of policies. (This is fairly explicit in the ToS pop-up that you're agreeing to the policies). So when the agreement sets the agreed_to_tos to true, it also marks down the acknowledged_policy_version as the current version. That way new users aren't immediately spammed with the "new policies!" banner right after they sign up and agree to terms.
Banner is set up so it's easy to bring it back if we change policies in the future. Just update CURRENT_POLICY_VERSION  when making changes to any policy pages, and the banner will re-appear. (It's arguable that this constant shouldn't live inside the banner component, but it seemed reasonable enough to me. If anyone has strong feelings, let me know where would be a better place to locate it.)
Sets the official date of policy change to Sep 30, 2021, when this stuff is expected to go to Prod. Also sets that date on both Privacy Policy and Terms pages.
Involves a DB migration: adds new column acknowledged_policy_version of type date  to the users table. If user has never done an acknowledgment, should be NULL.

Checklist:

[x] I merged latest trunk
[x] I manually verified the change
[x] I added labels to my PR
[ ] I tested in multiple browsers
[ ] I added relevant unit tests
[x] I have notified others of changes they need to make locally (migrations, jobs, package updates, etc)

When I click the X in the banner, the banner disappears for a moment and then comes right back.

Well that's bad.

When I click the X in the banner, the banner disappears for a moment and then comes right back.

wierd that didn't happen to me, i even refreshed the page and it didn't come back 😕

When I click the X in the banner, the banner disappears for a moment and then comes right back.

Well that's bad.

We debugged this together - the rdev db has some weird bugs in it -- this PR works for me. I'll fix the rdev snapshot.


add API validation to workflow

this doesn't use api-extractor, because i've still got no clue how that works. instead it runs TypeDoc validator (with some settings tweaked for sanity).
this PR marked as draft because currently none of openai is documented, and neither is STT/TTS. will come back to this PR once everything else is finalized-ish in terms of API, to minimize merge conflicts later down the line.

@bcherry i unexported some things and set some others to be internal, please have a look and make sure everything is as it should be (notably unexported api_proto on openai)

lukas is working on a better implementation using api-extractor, i'm waiting for that instead


Invalid Call : Nonexistent function 'snapshotsSaveGame' in base 'JNISingleton'

I am using Godot 3.5 and downloaded both the plugin for android and the helper Godot plugin directly from asset library ( also tried manually).
The sign in successfully works. So does the "snapshots_load_game" function. But when I want to save game this error occurs!

Hi @Faisul-Islam thanks for you question!
This error can happen when the method you're trying to call doesn't exist, it's misspelled, or the parameters provided are wrong, but this case is strange, since you say that the load save game method is working.
I was thinking of suggesting checking the version of the plugin you're using, because saved games feature was introduced the latest, but if you have loading, saving should work also.
I checked spelling and arguments and they look correct, too. My last suggestion would be trying the godot plugin for this library, here. The plugin is doing basically the same you do (check it here), but it also contains a demo project that might help you further.
Please, let me know if this helped you!

Isn't this repo that you linked the same helper godot plugin that can be downloaded directly from asset library? Just the example folder stripped.
Anyway, one another thing is that, weirdly I also got errors of nonexistent signal's for these two signal ( which I have commented out ). After commenting that actually I am getting the error of the issue I opened.

And, here is the plugin version :

Ok, using this works.

So using the plugin works? that's strange, apparently you were doing the same as the plugin does. I will close the issue for now, but let me know if you need anything else!


go_1_17: remove

1.17 has been EOL since the release of 1.19
Don't want to mark a bunch of packages that still build as broken so just adding a comment that the vendor is problematic.
Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

@ofborg build alertmanager-bot deepsea filtron git-hound gobetween httpdump kcli kfctl kubemqctl magnetico opensnitch pam_ussh pg_featureserv shadowfox shhgit ssb waitron wrap wuzz

cc package maintainers
@austinbutler
@brianmcgee
@cideM
@cswank
@dasj19
@dguibert
@fabaff
@infinisil
@lukegb
@marsam
@mmahut
@mvnetbiz
@pradeepchhetri
@raboof
@rnhmjoj
@sikmir
@tomberek
@wakira
@yusdacra
cc others who may be interested
@ajs124
@mweinelt
@SuperSandro2000

I can't push to this branch, but here is a commit to fix magnetico:
The following changes since commit ca79305d8f8d08ed295c70bb4e106310a6100348:

  magnetico: 0.12.0 -> unstable-2022-08-10 (2022-10-25 12:25:28 +0200)

are available in the Git repository at:

  git@github.com:rnhmjoj/nixpkgs.git pr-magnetico

for you to fetch changes up to ca79305d8f8d08ed295c70bb4e106310a6100348:

  magnetico: 0.12.0 -> unstable-2022-08-10 (2022-10-25 12:25:28 +0200)

----------------------------------------------------------------

I can't push to this branch, but here is a commit to fix magnetico:

Can you open a PR?

I would but github doesn't let me choose you remote for some reason. You can just cherry-pick my commit into rm-go117.

Those are not to many packages. Can we go through them one by one and either update them or mark them as broken? Relying on a none buildable FOD is really brittle and not really something we should do.

I would but github doesn't let me choose you remote for some reason.

I meant open a PR to master in this repo just for the magnetico change.

You can just cherry-pick my commit into rm-go117.

No, I don't want to include it here as it's more than just a trivial bump. Also go-bindata is unnecessary now and can be removed.

Can we go through them one by one and either update them

The only way some of them can be updated is if we send PRs upstream ourselves.

mark them as broken
Relying on a none buildable FOD is really brittle and not really something we should do.

I don't disagree but regardless of whatever comments we add to the file when it's marked as broken if the package still builds with the cached FOD we can't stop people from removing the broken setting.

No, I don't want to include it here as it's more than just a trivial bump.

What's wrong with this? If I do that in another PR It would possibly leave the package in a broken state in master.

Also go-bindata is unnecessary now and can be removed.

Thanks, fixed.

I don't disagree but regardless of whatever comments we add to the file when it's marked as broken if the package still builds with the cached FOD we can't stop people from removing the broken setting.

Also remove vendorSha to prevent this? or we add a comment that simply removing meta = broken is not allowed and then we must insist on it.

go-mockery: https://github.com/NixOS/nixpkgs/pull/198849

livedl: https://github.com/NixOS/nixpkgs/pull/197888

@ofborg eval

This PR marked pam_ussh broken, but the NixOS sudo module depends on pam_ussh by setting usshAuth = true in https://github.com/NixOS/nixpkgs/blob/b37bcf7ce96fa3879e4b141d9c8b15a78ab23f46/nixos/modules/security/sudo.nix#L248
https://gist.github.com/ivan/3b135fc7795e44b3ff9d95f017de482d is the nixos-rebuild error for nixpkgs master.

Is there a common workaround for fixing packages marked as broken here? Trying to reproduce the unreproducible vendor issue, I didn't even manage to build once the .go-modules attribute:
shadowfox> patching sources
shadowfox> configuring
shadowfox> building
shadowfox> go: downloading github.com/gen2brain/dlgs v0.0.0-20180629122906-342edb4c68c1
shadowfox> go: downloading github.com/go-ini/ini v1.42.0
shadowfox> go: downloading github.com/mitchellh/go-homedir v1.1.0
shadowfox> go: downloading github.com/skratchdot/open-golang v0.0.0-20190402232053-79abb63cd66e
shadowfox> github.com/SrKomodo/shadowfox-updater imports
shadowfox>      github.com/gen2brain/dlgs imports
shadowfox>      github.com/gopherjs/gopherjs/js: no required module provides package github.com/gopherjs/gopherjs/js; to add it:
shadowfox>      go get github.com/gopherjs/gopherjs/js

shadowfox upstream hasn't been updated in three and a half years ... still using go 1.12. You could try to update it but may not be trivial.

@doronbehar you might be looking to what I did to filtron: https://github.com/NixOS/nixpkgs/pull/202397
which was marked as broken in this PR, maybe you can manage all the dependencies like I did on filtron


Plotly Graph having hyperlinks does not work in VS Code but works in Jupyter Notebook

Applies To

[X] Notebooks (.ipynb files)
[X] Interactive Window and/or Cell Scripts (.py files with #%% markers)

What happened?
I have created a plotly graph having a title text. The title text contains  HTML element so that if someone clicks on the title, they will be redirected to a web page. The title text is not clickable, and nothing happens when I click on it in VS Code. But it seems to work in Jupyter Notebook. Below is the sample graph:

The text (i) highlighted with yellow color is a hyperlink, but it does not open up the browser window and redirect to this URL.
Below is the code which I used:
figure = go.Figure()
figure.add_trace(go.Scatter(x = result['Text Length'], y = result['Average Words Per Sentence'], mode='markers'))
figure.update_layout(title = {'text': 'Text Length(i)
A small description', 'x': 0.5, 'xanchor': 'center'})
figure.update_layout( xaxis = dict(title = 'Text Length(i)', automargin = True))

VS Code Version
1.78.2
Jupyter Extension Version
v2023.4.1011241018
Jupyter logs
No response
Coding Language and Runtime Version
No response
Language Extension Version (if applicable)
No response
Anaconda Version (if applicable)
No response
Running Jupyter locally or remotely?
Local

Thank you for filing this issue and sorry you are running into this.
Please could you try this in Jupyter Lab and let me know whether it works

Closing this issue as its been over 4 weeks, since the information was requested.
We'll be happy to reopen the issue when the requested information has been provided.


Make tfjsbackend private

Make TFJSBackend constructor and destructor private, and add a factory method to provide TFJSBackend.

This change is

I didn't figure out a way to catch c++ exception in typescript, so I add a check of NodeJSKernelBackend here to see if the binding is successful. Let me know if this is not the right way to do it.


InBuild AppLock

Add inbuild AppLock helps to protect conversation little more.

This is on the todo list, blocked by the non-existing settings page


Pull default key from conf instead of in-function

This partially addresses https://github.com/kpdyer/fteproxy/issues/176.

Looks good. Thanks!


ERROR: Failed to set up Chromium r800071! Set "PUPPETEER_SKIP_DOWNLOAD" env variable to skip download.

Steps to reproduce
Tell us about your environment:

Puppeteer version: N/A
Platform / OS version: PopOS Linux
URLs (if applicable):
Node.js version:

# node -v
v10.19.0
# npm -v
6.14.8

What steps will reproduce the problem?
Please include code that reproduces the issue.

npm install -g puppeteer

What is the expected result?
It installs
What happens instead?
# npm install -g puppeteer

><EMAIL_ADDRESS>install /usr/local/lib/node_modules/puppeteer
> node install.js

ERROR: Failed to set up Chromium r800071! Set "PUPPETEER_SKIP_DOWNLOAD" env variable to skip download.
{ [Error: EACCES: permission denied, mkdir '/usr/local/lib/node_modules/puppeteer/.local-chromium']
  errno: -13,
  code: 'EACCES',
  syscall: 'mkdir',
  path: '/usr/local/lib/node_modules/puppeteer/.local-chromium' }
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>install: `node install.js`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>install script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR!     /root/.npm/_logs/2020-10-08T18_28_23_193Z-debug.log
# echo $PUPPETEER_SKIP_DOWNLOAD
true

Here's something that works for me: https://github.com/puppeteer/puppeteer/issues/5656#issuecomment-641412196

I was able to get my Github Action to work with the latest version of puppeteer.
What a great tool when it works! I have it capturing every page of a site before / after commit and doing a diff using Imagemagick.
I'll close this now as I've figured it out. Thanks!

Steps to reproduce
Tell us about your environment:
* Puppeteer version: N/A

* Platform / OS version: PopOS Linux

* URLs (if applicable):

* Node.js version:

# node -v
v10.19.0
# npm -v
6.14.8

What steps will reproduce the problem?
Please include code that reproduces the issue.
1. `npm install -g puppeteer`

What is the expected result?
It installs
What happens instead?
# npm install -g puppeteer

><EMAIL_ADDRESS>install /usr/local/lib/node_modules/puppeteer
> node install.js

ERROR: Failed to set up Chromium r800071! Set "PUPPETEER_SKIP_DOWNLOAD" env variable to skip download.
{ [Error: EACCES: permission denied, mkdir '/usr/local/lib/node_modules/puppeteer/.local-chromium']
  errno: -13,
  code: 'EACCES',
  syscall: 'mkdir',
  path: '/usr/local/lib/node_modules/puppeteer/.local-chromium' }
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>install: `node install.js`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>install script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR!     /root/.npm/_logs/2020-10-08T18_28_23_193Z-debug.log
# echo $PUPPETEER_SKIP_DOWNLOAD
true

I have same problem, and I try installation for solving my problem
npm i puppeteer
# or "yarn add puppeteer"

I had to use --unsafe-perms to install it successfully

*--unsafe-perm, not --unsafe-perms 😉

npm install --ignore-scripts puppeteer

npm install --ignore-scripts puppeteer

For yarn, yarn add --ignore-scripts puppeteer.

For me this is working fine on local , but I got same error on Jenkins , any fix for that ?

I set export PUPPETEER_SKIP_DOWNLOAD=true on bash terminal then reinstalled it and it work fine. If you are on windows, I think the syntax looks like this: SET PUPPETEER_SKIP_DOWNLOAD=true

npm install --ignore-scripts puppeteer

This was the error I encountered when I used
npm i puppeteer
then I inserted ignore-scripts and it worked like a charm
npm i --ignore-scripts puppeteer
`
npm i puppeteer
npm ERR! code 1
npm ERR! path C:\Users\zero\Projects\scrapeTheWeb\node_modules\puppeteer
npm ERR! command failed
npm ERR! command C:\WINDOWS\system32\cmd.exe /d /s /c node install.js
npm ERR! ERROR: Failed to set up Chrome r115.0.5790.102! Set "PUPPETEER_SKIP_DOWNLOAD" env variable to skip download.
npm ERR! [Error: EPERM: operation not permitted, mkdir 'C:\Users\zero.cache'] {
npm ERR!   errno: -4048,
npm ERR!   code: 'EPERM',
npm ERR!   syscall: 'mkdir',
npm ERR!   path: 'C:\Users\zero\.cache'
npm ERR! }
npm ERR!      C:\users\zero\AppData\Roaming\npm-cache_logs\2023-08-02T12_56_45_152Z-debug-0.log
`

I solve the problem use this config, npm config set PUPPETEER_DOWNLOAD_BASE_URL https://cdn.npmmirror.com/binaries/chrome-for-testing


Fix REPL binding

This PR fixes 2 issues:

Currently, special local _raised  doesn't work in C method frames.
Local variables assigned in REPL aren't stored in the binding.

I made #441 so please tell me if it is not enough.

@ko1 I can confirm that #441 fixed both issues. thanks!


Visual hashing of master password

https://wiki.mozilla.org/Identity/Watchdog/Visual_Hashing and http://mattt.github.com/Chroma-Hash/ as examples.

Since I am not developing this project anymore, I'm archiving the repository.


[Bug]: Bitbucket issue, pr missing in scope

Preflight Checklist

[X] I have read the Contribution.md for this project.
[X] I agree to follow the Code of Conduct that this project adheres to.
[X] I have searched the issue for a feature request that matches the one I want to file, without success.

Version
0.0.1
Current Behavior
Currently PR and issues are missing for bitbucket Oauth scopes.
Both is code and docs.
Expected Behavior
Scopes should be :
['repository', 'account', 'email', 'issue', 'pullrequest']

Additional Information
No response

Sure go ahead @Sukh0204

Hi @Sukh0204  what's the update on this issue

Hello sir, Apologies for the delay, I'm working on the issue.


Gift Entry: List View Sort Bug Fix

Critical Changes
Changes
Issues Closed
Community Ideas Delivered
New Metadata
Deleted Metadata

@kenlewis-sfdo Thanks for catching that, we probably want to preserve the sort order even if we retrieve more records. I just pushed up that update. That way it's up to the user to reset the sort order if they want to.


Bot try to enter the channel where it's not in, if possible

Instead of inviting bot every channel, try to enter the channel if not in.

If chat_postMessage respond with error not_in_channel then try to join, and then re-send the message.

Another alternative is using signals. When new recipient created, check the channel and enter the channel.
But related PR #24 implementation utilizes cache. As channels are cached, need an way to manually invalidate the cache.


Update angular docs

Update the installation steps and add a section for our carbon-angular-starter app

thanks! merging in, will be live when we push website next


production settings for deployment in server

Coverage decreased (-0.14%) to 95.21% when pulling 569a20c40d1c564b0f13a6bf0e57411e90302d70 on setup_remote into f4e7d27c8df8806d741d931ba537b3386153b6e8 on master.


[Technology] Missing related Product

Missing related product.  Could be related to https://github.com/hlxsites/moleculardevices/issues/403 , as the document for ID5 is currently missing. Still would be good to check back after the product is imported to make sure the problem is fixed.
Example:
https://franklin.moleculardevices.com/technology/western-blot#related-products-services
https://www.moleculardevices.com/technology/western-blot#relatedproducts
SpectraMax iD5 Multi-Mode Microplate Reader is listed as a related product in the word document, but does not appear in the rendered Related Products block. Most likely it has to do with the fact that it is a series product.
Original

Franklin

On https://main--moleculardevices--hlxsites.hlx.page/technology/time-resolved-fluorescence-trf-tr-fret-htrf#related-products-services there is actually no product shown.

Should be fixed at the moment, I added H1s for all series products.

Why are h1 needed if we have Titel in meta data?

@mhaack there is a lot of code working with h1s. Sometimes it falls back to title, if h1 is empty, but I think it is safer to have the h1s, especially cards and carousels mostly are looking for the h1s first as they match the exact text from the original website, so it is more performant.
In this case, the filter was based on h1 only: https://github.com/hlxsites/moleculardevices/blob/main/blocks/related-products/related-products.js#L15 . I could've added a fallback to title there as well, but it would be more ineficient.

Not sure if I really like the current approach as the default Franklin approach is sort of opposite. Not 100% but sort of. Here it takes H1 first (for page title) and meta data second.
So having a heading one in the doc’s is perfectly fine. But the way we use it in index and code I’m not sure. My preference would be getting rid of ‘h1’ in index totally. As that feels more “standard”.
Let have a chat tomorrow.

Two more general thoughts on this, the more I think about it:

Sometimes it falls back to title, if h1 is empty,

I think we should have this consistent across all blocks.

Think this is too complicated for the average author. I know we did not question it because it was that was before. We should not forget about ease of use for the authors.

I will start by saying that I don't have necessarily a preference
Unfortunately, there are a lot of cases where the title and h1 don't match and the original website uses the h1 information for  cards titles and breadcrumbs (and for sure other uses cases which I'm missing now on the spot). If we wanted to remove the h1s from the index, we would need to store this info in yet another metadata field and index that one, as it is not in anything else we store/index.


Replace eval(coverage.js) in tests with proper import

Slurping in utils/coverage.js via a manual file read and eval() is a
big and unnecessary hack. Turn it into a proper function instead.

Codecov Report

Merging #170 into master will increase coverage by 0.53%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #170      +/-   ##
==========================================
+ Coverage   38.29%   38.83%   +0.53%
==========================================
  Files          70       70
  Lines        2230     2230
  Branches      312      312
==========================================
+ Hits          854      866      +12
+ Misses       1152     1142      -10
+ Partials      224      222       -2

Impacted Files
Coverage Δ

data/RecipeApi.js
56.98% <0%> (+4.3%)
:arrow_up:

core/selectors.js
92.85% <0%> (+4.76%)
:arrow_up:

data/MetadataApi.js
37.28% <0%> (+6.77%)
:arrow_up:

components/Modal/ExportRecipe.js
90.9% <0%> (+9.09%)
:arrow_up:

components/ListView/DependencyListView.js
42.85% <0%> (+14.28%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b6017e0...0f15e9c. Read the comment docs.

I added another commit "Drop unsafe Content-Security-Policy from Cockpit manifest" as I thought that would work with dropping the eval(), but in CI it still fails. Locally the cockpit integration test works fine, so this will be rather ugly to debug. I reverted that second commit for now, but even without that this change still makes sense IMHO.


Homework 4

I'm having a tiny bit of trouble with homework 4. Would anybody be willing to post an example of their code? I'm not entirely sure how to develop my homework 3.

Hi there,
I will be posting an example later today along with a video.  Hopefully
that will help!
Michael
On Fri, Feb 8, 2019, 11:10 AM Jack Stob<EMAIL_ADDRESS>wrote:

I'm having a tiny bit of trouble with homework 4. Would anybody be willing
to post an example of their code? I'm not entirely sure how to develop my
homework 3.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/Montana-Media-Arts/441-WebTech-Spring2019/issues/7,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAP3RG_jXCPH1pBhJELxHkefPYpJQnNEks5vLb2NgaJpZM4aw4h-
.

Hey here is my code. It's a lot and very mess but I'll post it anyway. (I'm not done yet)
https://github.com/ChristoffSomm/MART_441-Web_Technologies/blob/master/HW3/index.html
I wrote a quick a quick HTML file for you to look at and I hope it explains what I'm doing.
https://github.com/ChristoffSomm/MART_441-Web_Technologies/blob/master/HelpCode/Example.html
My way is most likely the not the most efficient way but it's one way.

Hi Christoffer,
Wow!  That was serious!  I will take a closer look when I am in front of a
computer again.  Thanks!
On Fri, Feb 8, 2019, 1:37 PM Christoffer Sommerfeld <
<EMAIL_ADDRESS>wrote:

Hey here is my code. It's a lot and very mess but I'll post it anyway.
(I'm not done yet)
https://github.com/ChristoffSomm/MART_441-Web_Technologies/blob/master/HW3/index.html
I wrote a quick a quick HTML file for you to look at and I hope it
explains what I'm doing.
https://github.com/ChristoffSomm/MART_441-Web_Technologies/blob/master/HelpCode/Example.html
My way is most likely the not the most efficient way but it's one way.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/Montana-Media-Arts/441-WebTech-Spring2019/issues/7#issuecomment-461938973,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAP3RM6lez5IujXX_OtJ5UFdTzp5CWR7ks5vLeAjgaJpZM4aw4h-
.

@ChristoffSomm thank you so much! that's amazing. I'm gonna take a look at this and see how I can add it to my code. :)

This is my answer to the assignment
https://github.com/allenharguess701/Mart441/tree/master/HW-4


Duplicate class in Kotlin Android - kotlin-stdlib old dependency

Trying to run the app with this package in Flutter 3.7.6 (Dart 2.19.3) results in duplicate class Kotlin
Error message:
FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':app:checkDebugDuplicateClasses'.
> A failure occurred while executing com.android.build.gradle.internal.tasks.CheckDuplicatesRunnable
   > Duplicate class kotlin.collections.jdk8.CollectionsJDK8Kt found in modules jetified-kotlin-stdlib-1.8.10 (org.jetbrains.kotlin:kotlin-stdlib:1.8.10) and jetified-kotlin-stdlib-jdk8-1.7.10 (org.jetbrains.kotlin:kotlin-stdlib-jdk8:1.7.10)
     Duplicate class kotlin.internal.jdk7.JDK7PlatformImplementations found in modules jetified-kotlin-stdlib-1.8.10 (org.jetbrains.kotlin:kotlin-stdlib:1.8.10) and jetified-kotlin-stdlib-jdk7-1.7.10 (org.jetbrains.kotlin:kotlin-stdlib-jdk7:1.7.10)
     Duplicate class kotlin.internal.jdk7.JDK7PlatformImplementations$ReflectSdkVersion found in modules jetified-kotlin-stdlib-1.8.10 (org.jetbrains.kotlin:kotlin-stdlib:1.8.10) and jetified-kotlin-stdlib-jdk7-1.7.10 (org.jetbrains.kotlin:kotlin-stdlib-jdk7:1.7.10)
     Duplicate class kotlin.internal.jdk8.JDK8PlatformImplementations found in modules jetified-kotlin-stdlib-1.8.10 (org.jetbrains.kotlin:kotlin-stdlib:1.8.10) and jetified-kotlin-stdlib-jdk8-1.7.10 (org.jetbrains.kotlin:kotlin-stdlib-jdk8:1.7.10)
     Duplicate class kotlin.internal.jdk8.JDK8PlatformImplementations$ReflectSdkVersion found in modules jetified-kotlin-stdlib-1.8.10 (org.jetbrains.kotlin:kotlin-stdlib:1.8.10) and jetified-kotlin-stdlib-jdk8-1.7.10 (org.jetbrains.kotlin:kotlin-stdlib-jdk8:1.7.10)
     Duplicate class kotlin.io.path.ExperimentalPathApi found in modules jetified-kotlin-stdlib-1.8.10 (org.jetbrains.kotlin:kotlin-stdlib:1.8.10) and jetified-kotlin-stdlib-jdk7-1.7.10 (org.jetbrains.kotlin:kotlin-stdlib-jdk7:1.7.10)
     Duplicate class kotlin.io.path.PathRelativizer found in modules jetified-kotlin-stdlib-1.8.10 (org.jetbrains.kotlin:kotlin-stdlib:1.8.10) and jetified-kotlin-stdlib-jdk7-1.7.10 (org.jetbrains.kotlin:kotlin-stdlib-jdk7:1.7.10)
     Duplicate class kotlin.io.path.PathsKt found in modules jetified-kotlin-stdlib-1.8.10 (org.jetbrains.kotlin:kotlin-stdlib:1.8.10) and jetified-kotlin-stdlib-jdk7-1.7.10 (org.jetbrains.kotlin:kotlin-stdlib-jdk7:1.7.10)
     Duplicate class kotlin.io.path.PathsKt__PathReadWriteKt found in modules jetified-kotlin-stdlib-1.8.10 (org.jetbrains.kotlin:kotlin-stdlib:1.8.10) and jetified-kotlin-stdlib-jdk7-1.7.10 (org.jetbrains.kotlin:kotlin-stdlib-jdk7:1.7.10)
     Duplicate class kotlin.io.path.PathsKt__PathUtilsKt found in modules jetified-kotlin-stdlib-1.8.10 (org.jetbrains.kotlin:kotlin-stdlib:1.8.10) and jetified-kotlin-stdlib-jdk7-1.7.10 (org.jetbrains.kotlin:kotlin-stdlib-jdk7:1.7.10)
     Duplicate class kotlin.jdk7.AutoCloseableKt found in modules jetified-kotlin-stdlib-1.8.10 (org.jetbrains.kotlin:kotlin-stdlib:1.8.10) and jetified-kotlin-stdlib-jdk7-1.7.10 (org.jetbrains.kotlin:kotlin-stdlib-jdk7:1.7.10)
     Duplicate class kotlin.jvm.jdk8.JvmRepeatableKt found in modules jetified-kotlin-stdlib-1.8.10 (org.jetbrains.kotlin:kotlin-stdlib:1.8.10) and jetified-kotlin-s

Basically, this occours because of old kotlin-stdlib-jdk7 and kotlin-stdlib-jdk8 dependecies, which should be replaced by kotlin-stdlib when build the package.
Can circumvent by override how jdk7 and jdk8 versions are resolved (app/build.gradle)
dependencies {
    constraints {
        implementation("org.jetbrains.kotlin:kotlin-stdlib-jdk7:1.8.0") {
            because("kotlin-stdlib-jdk7 is now a part of kotlin-stdlib")
        }
        implementation("org.jetbrains.kotlin:kotlin-stdlib-jdk8:1.8.0") {
            because("kotlin-stdlib-jdk8 is now a part of kotlin-stdlib")
        }
    }
}

source: https://stackoverflow.com/questions/75263047/duplicate-class-in-kotlin-android

I've edited the example to depend on kotlin-stdlib instead.
Does that fix this issue or is there something else to do on the library side?
You can take a look at the changes in PR #3

I mentioned this problem and potential fixes as part of the 1.0.1 release available now on pub.dev.
If you find anything more to do about this problem, feel free to share it :)