Inserting directly into database

Hi,
Would someone be able to give me some assistance as to how the procedure works when inserting data directly into the database.
Some background, I've created a documentation script using PoSH that audits servers and then parses that information into HTML which is inserted directly into the bookstackdb. It will check to see if a page exists for the hostname, using the code below;
`
<# MYSQL Find IF Page exists for $Hostname #>
$Pages = Query-Database -DBUser $BookstackDBUser -DBPass $BookstackDBPass -DBName $BookstackDBDatabase -DBHost $BookstackDBHost -DBQuery "SELECT id,name FROM pages"
if ($Pages.name -notcontains $Hostname) {
$PageID = $($Pages.id | Measure-Object -Maximum).Maximum
$PageID++
$DBStatus   = "New"
} else {
$PageID = $(Query-Database -DBUser $BookstackDBUser -DBPass $BookstackDBPass -DBName $BookstackDBDatabase -DBHost $BookstackDBHost -DBQuery "SELECT id FROM pages WHERE name = '$hostname'").id
$DBStatus   = "Update"
}
`
The $DBStatus then actions the below at the end of the script;
`
If ($DBStatus -eq "Update") {
$MysqlQuery.CommandText = 'UPDATE bookstackdb.pages SET html = "'+$HTML+'" WHERE id = "'+$PageID+'";'
$MysqlQuery.ExecuteNonQuery() | Out-Null
} Elseif ($DBStatus -eq "New") {
$MysqlQuery.CommandText = 'INSERT INTO bookstackdb.pages (name, book_id, chapter_id, slug, html, text, priority, created_by, updated_by, markdown, revision_count) VALUES ("'+$Hostname+'","11","0","'+$Hostname+'","'+$HTML+'","VARCHAR","0","7","7","VARCHAR","0");'
$MysqlQuery.ExecuteNonQuery() | Out-Null
} Else {
<# Continue #>
}
`
The data is being put into the following location correctly, bookstackdb.pages. It is being given the correct book_id which we wish for the page to fall under, book_id: 11 the slug is set correctly to $Hostname
However, when going into the book in the web interface, there are no pages under thet book, and when trying to browse to the page directly, an error for not found is returned.
Are there any functions in the DB or relationships that need to be linked to have pages that are put directly into bookstackdb.pages to appear in the web interface?
Many thanks,
Danny.

Hi @DannyGlover-VP,
A number of operations run in BookStack when content is saved, Therefore direct DB insertion is not officially supported.
That said, The issue you’re facing is probably due to the permission system being out of date after manual DB operations. You’ll also find that searching may be affected since the search indexes will need to be rebuilt.
Running both of the following commands, in your BookStack install directory, should rebuild both the search and permissions indexes:
php artisan bookstack:regenerate-search
php artisan bookstack:regenerate-permissions

Be aware both of these commands can be quite intensive if there’s a lot of content in your system.

Hi,
Thank you for your response. This has indexed the results. It has left us with an error still but I will investigate and try resolving this myself before bothering you further.
I will post results and any fix tomorrow on this thread.
Thank you for your help thus far.
Danny

php artisan bookstack:regenerate-search

oh didn't know, that there is a command for this, I solved it by updating the table manually. Maybe I take a look to improve the command to use it for single pages.

Hi,
@ssddanbrown @ezzra
Apologies for the delay on this. So as per my promise, I'll try give a overview of what I changed to get this working, hopefully it can help someone in the future.
In all instances where PoSH does an 'INSERT INTO' query, on anything that handles date information, it uses the following command to insert the current time in the accepted format;
+$(get-date -Format 'yyyy-MM-dd hh:mm:ss')+
Secondly, the table bookstackdb.page_revisions has to link to a bookstackdb.page - I used some logic to do this, logic similar to;
$PageID = .. "SELECT id FROM pages WHERE name = '$hostname'"
It will then store that PageID and use similar to the below (this is truncated code)
INSERT INTO bookstackdb.page_revisions .... VALUES ("'+$PageID+'")
Finally, when the above INSERT INTO values are complete, for both bookstackdb.pages & bookstackdb.page_revisions the SSH script will launch an SSH session, navigate to the bookstack directory and run the below commands;
php artisan bookstack:regenerate-search
php artisan bookstack:regenerate-permissions
This solved the issues I was experiencing with automated documentation.
Many thanks for your help @ssddanbrown
I hope others using PoSH find this useful, hopefully it's transferable to other languages too.
Danny.

@DannyGlover-VP Awesome, Thanks for the update & glad to hear you got things working. An API is on the roadmap which, once implemented and released, would probably be ideal for these kind of scenarios since you won't have to interact with the DB directly and BookStack would run any extra operations as normal so keep an eye out for that.
@ezzra Would be fairly simple to modify the existing command for specific items but, for the core repo code, I'd like to keep these maintenance commands focused and simple, With the API in the future being the main method of these kind of operations.

With the API in the future being the main method of these kind of operations.

didn't know that an API is on the roadmap, great!

Hi,
Would someone be able to give me some assistance as to how the procedure works when inserting data directly into the database.
Some background, I've created a documentation script using PoSH that audits servers and then parses that information into HTML which is inserted directly into the bookstackdb. It will check to see if a page exists for the hostname, using the code below;
`
<# MYSQL Find IF Page exists for $Hostname #>
$Pages = Query-Database -DBUser $BookstackDBUser -DBPass $BookstackDBPass -DBName $BookstackDBDatabase -DBHost $BookstackDBHost -DBQuery "SELECT id,name FROM pages"
if ($Pages.name -notcontains $Hostname) {
$PageID = $($Pages.id | Measure-Object -Maximum).Maximum
$PageID++
$DBStatus = "New"
} else {
$PageID = $(Query-Database -DBUser $BookstackDBUser -DBPass $BookstackDBPass -DBName $BookstackDBDatabase -DBHost $BookstackDBHost -DBQuery "SELECT id FROM pages WHERE name = '$hostname'").id
$DBStatus = "Update"
}
`
The $DBStatus then actions the below at the end of the script;
`
If ($DBStatus -eq "Update") {
$MysqlQuery.CommandText = 'UPDATE bookstackdb.pages SET html = "'+$HTML+'" WHERE id = "'+$PageID+'";'
$MysqlQuery.ExecuteNonQuery() | Out-Null
} Elseif ($DBStatus -eq "New") {
$MysqlQuery.CommandText = 'INSERT INTO bookstackdb.pages (name, book_id, chapter_id, slug, html, text, priority, created_by, updated_by, markdown, revision_count) VALUES ("'+$Hostname+'","11","0","'+$Hostname+'","'+$HTML+'","VARCHAR","0","7","7","VARCHAR","0");'
$MysqlQuery.ExecuteNonQuery() | Out-Null
} Else {
<# Continue #>
}
`
The data is being put into the following location correctly, bookstackdb.pages. It is being given the correct book_id which we wish for the page to fall under, book_id: 11 the slug is set correctly to $Hostname
However, when going into the book in the web interface, there are no pages under thet book, and when trying to browse to the page directly, an error for not found is returned.
Are there any functions in the DB or relationships that need to be linked to have pages that are put directly into bookstackdb.pages to appear in the web interface?
Many thanks,
Danny.

Hello Danny
I am trying to insert the data directly to html column and i can successfully did that.
I am facing one challenge,whenever i run the insert command , a revision page should be created with the revision number.
If you can help me with this.
<EMAIL_ADDRESS>Thanks
Vikas Yadav


A request for a nuget release

Would it be possible to have this released as a nuget?
Or do I need to use PAKET or FAKE (I am not versed in those build tools) to add this as a source-dependency?
I am trying to use this as per this comment:

https://github.com/fsharp/FsAutoComplete/issues/849#issuecomment-965853373

Published here: https://www.nuget.org/packages/Ionide.LanguageServerProtocol/


Fix error in redis LRANGE syntax

It looks like Jitsu hasn't worked with Redis all this time. At least from the bdac1ba commit from 18.06.2021.
Redis LRANGE need two arguments, but Jitsu provide only one - https://redis.io/commands/lrange

@MAH69IK thank you!


Enhancement request: option to left align comment delimiters

It would be great to have a leftmost (or something related) option for the alignment of columns.
To force an insertion of comment markers in the first column.

See commit https://github.com/afro85/nerdcommenter/commit/695d4bd2442e995c43b96e89e01e542dd93da0f5 which looks like it might be related to this.

Isn't it what let g:NERDDefaultAlign = 'start' is for?

Thanks for letting me know! ;-) I am pretty sure, that this was not implemented when I opened the issue.


please add search option in V2.0.0 version.

please add search option in V2.0.0 version.

Search by filename?
We do have a plan to develop a filemanager extension that stores file metadata in MySQL. That makes it searchable.

yes search by filename.

We do have a plan to develop a filemanager extension that stores file metadata in MySQL. That makes it searchable.

very good. I'm impatiently waiting.
thank you. :)

Duplicate of #316 .

how to implement search box in laravel file manager v2.0.0?


useDefaultConfig on tests

Right now the tests of detekt-compiler-plugin relies in an "undefined behavior" of the core. They don't define a configuration nor use useDefaultConfig=true, so no rule should be run. Every rule is disabled by default unless you define the configuration or have useDefaultConfig=true.
I want to refactor how the configuration is created on detekt-core and remove that "undefined behaviour". For that reason I need to fix these tests to pass useDefaultConfig=true.
The problem is that I'm not able to do make it work. Please, help.

@3flex do you have any idea how to pass those arguments?

@detekt/maintainers a review here would help a lot I have other PRs pending to this.

Warnings

:warning:
This PR is approved with no milestone set. If merged, it won't appear in the detekt release notes.

  Generated by :no_entry_sign: dangerJS against 3d1d49472f43e80263693d78ee7ecea6ae3be8fd


Ajax Post Clearing all Properties of the Page

[EDIT by @guardrex to code fence the markup for display.]
When we do form Ajax-POST in a .net core 2.2 Page like below
<form asp-page-handler="Search" data-ajax="true" data-ajax-method="POST">
it is hitting the correct handler and clearing all the other properties which were not set in POST handler. I think its better to update the Page partially i.e. only changed properties and other properties should remain as it is. (after post returning to the same Razor Page)

The behavior is by-design. There's a note on it in the Model Binding topic ([Bind] attribute section) ...
https://docs.microsoft.com/aspnet/core/mvc/models/model-binding#bind-attribute
We only handle docs here, so we can't address engineering design considerations on the repo. You would need to take this up further with engineering.


Add optional digits param to OutboundCall

When initiating an OutboundCall, this new parameter lets you specify digits (DTMF tones) to play at the start of the call, before the websocket is established and the vocode bot gets going.
The format is described here:
https://www.twilio.com/docs/voice/api/call-resource#create-a-call-resource
"A string of keys to dial after connecting to the number, maximum of 32 digits. Valid digits in the string include: any digit (0-9), '#', '*' and 'w', to insert a half second pause. For example, if you connected to a company phone number and wanted to pause for one second, and then dial extension 1234 followed by the pound key, the value of this parameter would be ww1234#. Remember to URL-encode this string, since the '#' character has special meaning in a URL. If both SendDigits and MachineDetection parameters are provided, then MachineDetection will be ignored."
This provides a rudimentary way to let the bot walk a phone tree before it proceeds to interact with a human on the other side.  On the plus side, it's simple and fast.  On other hand, it's very rigid.  It requires you to know, in advance, what the menu options are and what's the right sequence of keys to press.  It doesn't automatically adapt if the target phone line changes its IVR.
We're still discussing how to enable that "flexible" phone-tree bot (https://discord.com/channels/1079125925163180093/1110400160950927370/1110400163392016474), but that effort is facing the challenge of how to play a DTMF tone into the <Stream>, or how to <Play> a tone without interrupting the stream.  Until we crack that nut, at least we'll have this basic way to play DTMF tones at the start of the call.

@ajar98 I updated ZoomDialIn to just construct the digits and pass into the parent constructor.
I did a local test where the vocode bot successfully joined a zoom meeting I set up.  I found it necessary to double the number of ws in the digits, otherwise Twilio seemed to submit the password digits too early.

thanks so much @shahafabileah !


Broken with Xcode 14

due to inability to isolate deinit calls to clean up

Workaround: try using v6.0.0

whew 6d1b3f8


Tiding the Refresh Token documentation

React Auth Kit introduced the Refresh Token feature from v1.4.3-0, but the docs are not completed yet.
This issue is for completing the refresh token documentation.

Okay, okay, I really need to set some time aside for this one

Okay, okay, I really need to set some time aside for this one

@shackra Any update?

@shackra Any update?

@shackra Any update?

no thus far, sorry for the delay

@shackra Any update?

no thus far, sorry for the delay

I would appreciate this too!

I would appreciate this too!

Okay, I will do a small backend to deploy on Heroku and give life to the documentation. There is no public REST APIs that simulate authentication thus one must be provided.

Okay, I will do a small backend to deploy on Heroku and give life to the documentation. There is no public REST APIs that simulate authentication thus one must be provided.

Ok. Please do so.

Ok. Please do so.

@shackra Updates?

@shackra Updates?

None so far, I'm sorry, I need more time

is there a chance that this documentation will happen at any time? I would like to help, but I miss understanding how it works so I can't document it. But without I think this really great project will die away.

yeah, sorry, I've been busy trying to come with this done

Okay, I will do a small backend to deploy on Heroku and give life to the documentation. There is no public REST APIs that simulate authentication thus one must be provided.

@shackra I can help with getting the API up on Heroku. Do you have any quick thoughts on what you want that mockup REST API to do?

Okay, I will do a small backend to deploy on Heroku and give life to the documentation. There is no public REST APIs that simulate authentication thus one must be provided.

@shackra I can help with getting the API up on Heroku. Do you have any quick thoughts on what you want that mockup REST API to do?

something that just return a valid JWT with a refresh JWT should do it


Need YAML support to do constraints check in simulated tests

Feature description
Need YAML support to do constraints check in simulated tests as testplan expects to verify the type, value and range of the attribute but when i tried to add the response facing the build error "TypeError: item[kResponseName].map is not a function".

Platform
all
Platform Version(s)
No response
Anything else?
Diff link: https://github.com/project-chip/connectedhomeip/compare/master...manjunath-grl:connectedhomeip:Constraint_Check_SupportFor_Simulatedtest
Testplan screenshot:

Execution logs:

exe_log.txt

That test plan does not really make sense: it's trying to verify the behavior of the test harness.


Configure Renovate

Welcome to Renovate! This is an onboarding PR to help you understand and configure settings before regular Pull Requests begin.
🚦 To activate Renovate, merge this Pull Request. To disable Renovate, simply close this Pull Request unmerged.

Update dependency popper.js to v2

Schedule: ["at any time"]
Branch name: renovate/popper.js-2.x
Merge into: master
Upgrade popper.js to 2.11.8

Update dependency twitter-bootstrap to v5

Schedule: ["at any time"]
Branch name: renovate/twitter-bootstrap-5.x
Merge into: master
Upgrade twitter-bootstrap to 5.3.3

🚸 Branch creation will be limited to maximum 2 per hour, so it doesn't swamp any CI resources or overwhelm the project. See docs for prhourlylimit for details.

[!WARNING]
Please correct - or verify that you can safely ignore - these dependency lookup failures before you merge this PR.

Failed to look up packagist package mikey179/vfsStream

Files affected: composer.json

❓ Got questions? Check out Renovate's Docs, particularly the Getting Started section.
If you need any further assistance then you can also request help here.

This PR has been generated by Renovate Bot.

Renovate is disabled
Renovate is disabled because there is no Renovate configuration file. To enable Renovate, you can either (a) change this PR's title to get a new onboarding PR, and merge the new onboarding PR, or (b) create a Renovate config file, and commit that file to your base branch.


Spyder raises an error when deleting text in help box under "plain text" mode

Problem Description
Spyder raises an internal error when help display mode is set to "Plain Text", text is entered in the object box, and then the delete key is pressed too quickly/held down. Happens irrespective of the object being inspected or whether "source" is turned on or off.
What steps will reproduce the problem?

Set help display mode to "plain"
Set source to Console (so you can type)
Enter some text, like os.path.join or pd.DataFrame
Hold down backspace/delete key or press very rapidly

Proposed solution
Worst case, it could just be caught and passed since there appear to be no other ill effects, but there is probably a more elegant solution that actually fixes the root problem.
Traceback
  File "C:\ProgramData\Anaconda3\lib\site-packages\spyder\plugins\help.py", line 400, in <lambda>
    self.combo.valid.connect(lambda valid: self.force_refresh())
  File "C:\ProgramData\Anaconda3\lib\site-packages\spyder\plugins\help.py", line 759, in force_refresh
    self.set_object_text(None, force_refresh=True)
  File "C:\ProgramData\Anaconda3\lib\site-packages\spyder\plugins\help.py", line 774, in set_object_text
    found = self.show_help(text, ignore_unknown=ignore_unknown)
  File "C:\ProgramData\Anaconda3\lib\site-packages\spyder\plugins\help.py", line 983, in show_help
    self.set_plain_text(hlp_text, is_code=is_code)
  File "C:\ProgramData\Anaconda3\lib\site-packages\spyder\plugins\help.py", line 683, in set_plain_text
    self.plain_text.set_text(full_text, is_code)
  File "C:\ProgramData\Anaconda3\lib\site-packages\spyder\plugins\help.py", line 241, in set_text
    self.editor.set_text(text)
  File "C:\ProgramData\Anaconda3\lib\site-packages\spyder\widgets\sourcecode\codeeditor.py", line 1595, in set_text
    self.setPlainText(text)
TypeError: setPlainText(self, str): argument 1 has unexpected type 'bool'

Package Versions

Spyder version: 3.2.8
Python version: 3.6.4
Qt version: 5.6.2
PyQt5 version: 5.6
Operating system: Windows 10

Dependencies
pyflakes >=0.6.0 :  1.6.0 (OK)
pycodestyle >=2.3:  2.3.1 (OK)
pygments >=2.0   :  2.2.0 (OK)
pandas >=0.13.1  :  0.22.0 (OK)
numpy >=1.7      :  1.14.0 (OK)
sphinx >=0.6.6   :  1.6.6 (OK)
rope >=0.9.4     :  0.10.7 (OK)
jedi >=0.9.0     :  0.11.1 (OK)
nbconvert >=4.0  :  5.3.1 (OK)
sympy >=0.7.3    :  1.1.1 (OK)
cython >=0.21    :  0.27.3 (OK)
qtconsole >=4.2.0:  4.3.1 (OK)
IPython >=4.0    :  6.2.1 (OK)
pylint >=0.25    :  1.8.2 (OK)

I cannot reproduce this with Spyder 3.x (commit 27efc2ab4) using Python 3.7.0 64bits, Qt 5.9.6, PyQt5 5.9.2 on Linux.

I can reproduce this on my Windows 10 machine, my Windows 8.1 machine and my Fedora 28 VM on the latest 3.x commit (currently 4f387354), each running Python 3.6.6 x64, Qt 5.9.6, and PyQt 5.9.2, as well in a clean environment on Fedora 28 running Python 3.7.0. I don't think its 100% consistent, and doesn't always happen if the module isn't imported in the console first (as it should have been anyway), but the majority of the time it happens when following the above procedure.

@jitseniesen What Linux distro are you running, perchance? Did you try os.path.join and make sure to import os in the console beforehand? Did you hold down backspace as stated above? Perhaps your key repeat rate is set too low?

Okay, I got it now. It seems necessary to import os first in the console, and it happens about once every three tries, but I do get the same error.


[BUG] Simulated hands do not scroll in 2023.2

Describe the bug
In Unity 2023.2 Editor (beta), simulated hands do not scroll backwards/forwards. Not observed in 2023.1

What XRI version is being used in 2023.2?

2.5.1 (updated from 2.3.0 in 2021)

Having the same issue in Unity 2023.2.9f1.


Log PeerClosedStreamExceptions as warnings instead of errors

The GrpcExceptionHandler logs PeerClosedStreamException as an error. This is causing log spam in cloud environments where clients abruptly terminate. The exception should be logged as a warning instead.

Merged - thanks @ladinu

Thank you!


[Feature Request] 2 more lanes to support Beat Smith.

Hello! I'm a game developer that is creating an a Guitar Hero like Drum game for Oculus Quest, i prettend to use Moonscraper-Chart-Editor as official chart editor for the game, but, my planned drum kit have 7 itens instead of 5.
The name of the game is Beat Smith, and i plan to release on Oculus Store before Christmas.
I forked the chart editor, but i found a lot of dificulties to add 2 more lanes...
Can you add this feature? Or can you explain me how to do this?

This is the prototype working.
https://youtu.be/l-cy6NwYqHU

Moonscraper already handles this with the "Pro Drums" mode when editing a drums chart using cymbal/tom toggles. You can read more about it here- http://docs.c3universe.com/rbndocs/index.php?title=Drum_Authoring#Displaying_Tom_Gems
If you need to have cymbals and toms of the same colour at the same time, or new types of notes etc, then you're better off using a dedicated MIDI editor like Reaper.

And how can i see the cymbal/toms on Pro-Mode? What's the shortcut key to toggle this?
I think this will fit perfectly.
Thanks for you explanation!

No problem.


Slider does nor work for expo apps, managed workflow

Environment
"expo": "^36.0.0",
"react": "16.9.0",
"react-native": "https://github.com/expo/react-native/archive/sdk-36.0.1.tar.gz",
"@react-native-community/slider": "^2.0.8"
Description
Slider does not work on expo app, on managed workflow,
I tried two solutions:
1st:
1- npm install @react-native-community/slider –save
2-  import Slider from '@react-native-community/slider';
With that I am getting: "Invariant Violation: Invariant Violation: Invariant Violation: requireNativeComponent: "RNCSlider" was not found in the UIManager."
2nd:
1- npm install @react-native-community/slider –save
2- react-native link @react-native-community/slider
3- import { Slider } from 'react-native' ( instead of import Slider from '@react-native-community/slider';)
With this solution, component Slider comes from 'react-native' not the one from community, like link didn't do anything.
I wanted to use props: onSlidingStart, which is included in react-native-slider but not in deprecated slider from react-native.

I have the exact same environment from above and am seeing the same issue:
requireNativeComponent: "RNCSlider" was not found in the UIManager.

same here, imported as stated in the readme and getting the same error
requireNativeComponent: "RNCSlider" was not found in the UIManager

the same requireNativeComponent: "RNCSlider" was not found in the UIManager

Same:
requireNativeComponent: "RNCSlider" was not found in the UIManager.

Device: (0:0) (0 , n(...).requireNativeComponent) is not a function

Same. So is there a solution?
requireNativeComponent: "RNCSlider" was not found in the UIManager.

The community slider component is not yet available for managed workflow for expo.
Please continue to use import {Slider} from 'react-native', as it still exists in the core.
Once the slider component has been removed from the core, expo will support the community packages.
https://docs.expo.io/versions/latest/react-native/slider/

I'm not using Expo and I'm not yet developing for a Windows app, but I have the same error: Invariant Violation: requireNativeComponent: "RNCSlider" was not found in the UIManager.
PS > react-native --version
react-native-cli: 2.0.1
react-native: 0.61.4

PS > react-native info
info Fetching system and libraries information...
System:
    OS: Windows 10 10.0.19041
    CPU: (8) x64 Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz
    Memory: 3.44 GB / 15.89 GB
  Binaries:
    Node: 10.16.3 - C:\Program Files\nodejs\node.EXE
    Yarn: 1.19.1 - C:\Users\jhale\AppData\Roaming\npm\yarn.CMD
    npm: 6.14.8 - C:\Program Files\nodejs\npm.CMD
  IDEs:
    Android Studio: Version  <IP_ADDRESS> AI-193.69<IP_ADDRESS>14223
  npmPackages:
    react: ^16.11.0 => 16.12.0
    react-native: 0.61.4 => 0.61.4

From package.json: "@react-native-community/slider": "^3.0.3",
From yarn.lock:
"<EMAIL_ADDRESS>  version "3.0.3"
  resolved<EMAIL_ADDRESS>  integrity sha512-8IeHfDwJ9/CTUwFs6x90VlobV3BfuPgNLjTgC6dRZovfCWigaZwVNIFFJnHBakK3pW2xErAPwhdvNR4JeNoYbw==

Hello @JustynaKK!
I can see that the version used in this issue is very outdated.
Can you check if the same issue still exists on the latest version (v4.1.6)?

I am seeing this on android with package version 4.1.7.


#2748 passing request context to ConextValidate()

Signed-off-by: Nick Dimov<EMAIL_ADDRESS>

Looks like there is a test that actually asserts the line you changed

Submitted a fix. The problem  is that i can not run tests locally, they fail even in master:
--- FAIL: TestClient (35.47s)
    --- FAIL: TestClient/generate_client (0.00s)
        --- FAIL: TestClient/generate_client/packages_mangling (4.87s)
            utils_test.go:30:
                        Error Trace:    utils_test.go:30
                                                                client_test.go:133
                                                                client_test.go:234
                                                                client_test.go:309
                        Error:          Expect "// Code generated by go-swagger; DO NOT EDIT.

                                        package client
...

hope this will work!

@dimovnike what are the errors you see when you build locally?  Can you share which OS + CPU architecture you are developing on?

@dimovnike what are the errors you see when you build locally? Can you share which OS + CPU architecture you are developing on?

the build is ok but go test is failing.  I use Ubuntu 20.04, and go version go1.16.7 linux/amd64.
I just found this in the error log:

note: module requires Go 1.17

its probably because of this. I will update golang and will try again.


AJ-1030: allow multi-user WDS

Jira Ticket: https://broadworkbench.atlassian.net/browse/AJ-1030
Summary of changes:
Removes a Utils.cond that prevented non-workspace-owners from seeing WDS data tables. As of this PR, all users can see WDS … if that WDS was deployed as multi-user.
Reviewer: the diff for this PR looks super ugly due to formatting/prettier changes. Please please ignore whitespace when viewing the PR.
Testing strategy
Tested locally as two different users
Visual Aids
As workspace owner:

As workspace reader BEFORE this PR:

As workspace reader AFTER this PR:

Removes a Utils.cond that prevented non-workspace-owners from seeing WDS data tables. As of this PR, all users can see WDS … if that WDS was deployed as multi-user.

If WDS was NOT deployed as multi-user what would happen?  Would the user just get a spinny wheel forever?


Add rsync option to package command and improve performance

This is a fairly significant patch, but should not affect existing projects.  It adds a "packages.rsync" option (False by default).  When set to true, the package will be generated in a separate folder (packages.vmData defaults to "build/vm_data") via rsync and the compress option is enabled to generate an archive from the package, which is moved to the normal build/packages destination.
By mounting build/vm_data into the VM in your docker_composer.yml file, this allows the package to be built directly to the VM bypassing NFS to the local filesystem.  Only the final archive.tgz is moved into the local file system.  The vmData persists so the Build container can still perform additional tasks as needed, such as pushing the package into a remote repo.  Or, the local tgz archive can be used to deploy the package.
On a current real project, this reduced the normal "grunt package" command running from the build container from a 40-minute task, down to a TWO minute task.
Given the significant performance improvement, I'm marking this PR for Milestone 1, so let's get reviews of this approach.  (FYI it was modeled from some code in a "grunt deploy" task written for another project by Adam)

FYI: Travis tests are failing because of https://github.com/phase2/grunt-drupal-tasks/issues/304 and not because of anything in this PR.

@mike-potter Could we target this for a 1.1.0 milestone? I think the current master version is in good shape for a rc1 release and a stable one after a bit of testing.

Sure, we can do 1.1.0.  I agree that we need to get 1.0.0 released so people can start using the composer-based support.  And adding the "tempdir" option probably opens up other issues we'd want to work on for improving performance elsewhere in GDT that could benefit.


no way to tell the cavebot to move to an EXACT sqm

i need to move exactly to a specific SQM.. the solution should have been
:go1066626
move 106,662,6
IfTrue ($myx$#number<>#106) Goto $nlineoflabel:go1066626$
IfTrue ($myy$#number<>#662) Goto $nlineoflabel:go1066626$

but with this code, if the bot manage to walk to the sqm minus 1x or minus 1y, it will just infinitely loop, without ever walking the last sqm. because the cavebot will stop once it considers my position to be "close enough", like 1 sqm away..

this is probably a good thing to avoid heuristic bot detection, meaning this is probably a GOOD thing for antibanmode, but with antibanmode disabled, this behavior just cause trouble..
i guess we could either implement a "moveExactSQM" command, portable across even antibanmode, or make the Move command more accurate when "antibanmode = 0" ...

Its about move 106,662,6 : P its not going to exact sqm because blackd implemented there some kind of "random walking" so you wont get detected that easily : P there's probably margin of 1 or 2 sqm so even if you're 1 or 2 sqm's away from target location, bot will still consider it as if he reached exact waypoint. Change it and bot will always go to that exact location

@Neorisen yeah i think you're right - but this "random move" behavior should be confined to antibanmode = 0 - but what do you think about PR #103 ?

I haven't been playing with blackd code for a long time, but it looks good : P you have to be sure that antibanmode doesnt affect something else though, because that might get you banned(if u care about that ofc)

@Neorisen i only play on OT servers, and i always play with antibanmode = 0 ^^  and in fact, i think BlackD Proxy isn't compatible with Tibia 11.x anyway (i believe BattlEye and the tibia client QT-rewrite broke BlackD Proxy, and @blackdtools doesn't have time/motivation to update, as the QT-rewrite and BattlEye is a MAJOR challenge)

@divinity76 Yeah im aware of that but some OT servers are still banning bots : D You made me even look whats going on in otservlist and tibia.com :P Tibia is still alive in 2019 which is pretty amazing


Fix errors in firefox extension when destructuring the window

This has to go down as one of the weirder bugs I've come across. We use dnd-kit with our web app and within our Chrome and Firefox extensions. We came across some errors when dragging elements within our Firefox extension.
For some reason, destructuring the window object (returned from the getWindow function) causes the getComputedStyle function to throw an error: 'getComputedStyle' called on an object that does not implement interface Window.

When stepping through using the debugger, the window object is defined, and the elements that the code is getting the computed styles of are defined. When the window object isn't deconstructed and called directly (similar to how it's done in other places in the app) the error disappears.
The cause of this bug is unknown, and could be a bug within Firefox. However this small syntax change makes dnd-kit work perfectly in our Firefox extension. Unfortunately this error does make our Firefox extension unusable, so we'd appreciate it you considered merging this PR in.

Some insights if you're interested:

We considered that maybe the extension was running in a different context to the page, maybe the window object was different. However this wasn't the case. The window object returned from getWindow was the same if calling window directly.
This was also the case if we changed the code to this: const { getComputedStyle } = window. It caused the same error, which ruled out the getWindow function.
The element that was being dragged was defined and within the document.
We considered that the Firefox extension blocked certain calls to the window, but that was disproved pretty quickly.
We considered that maybe the getComputedStyle was conflicting with the global getComputedStyle. It's hard to prove this though, and this could be a bug with how Firefox deals with extensions.

Changes look good to me 🚢
Definitely a weird one, thanks for providing a detailed summary of your investigation.

Thank you for the quick turnaround!


Is there a way to change colors?

I don't understand the rgba color method calculations you use...but it looks like red represents light population, and it bursts into yellow (and even white?) the more "weight" coordinates have...
I am replacing the heatmap in my app with this one...and wish to keep visual compatibility.
Is it possible to go green means light population, yellow means medium, and red is heaviest?  I see you are using "floatdensity" as a trigger for the color, but don't exactly know what that is doing since my understanding of rgba is lacking.
Thanks in advance for answering all my questions :)

in LFHeatMap.m look for a comment market // Step 3. The rgba array is computed here, you can play with the values here to get any color scheme you like.

Solved!  My issue when working on this is two fold... a: I did not know what the formula you were using with the colors did... and b: when I did look at it closely I did not realize I should've applied the "filterDensity" to each NEWly created color prior to creating the image ... So, here is my addition:
Step 3: (after // Normalize density to 0..1
           floatDensity = (float)density[i] / (float)maxDensity;
            if (floatDensity >= 0.90)
            {
                // Red component
                rgba[indexOrigin] = 228 * floatDensity;

                // Green component
                rgba[indexOrigin+1] = 0 * floatDensity;

                // Blue component
                rgba[indexOrigin+2] = 0 * floatDensity;

            }
            else if (floatDensity >= 0.75)
            {
                // Red component
                rgba[indexOrigin] = 249 * floatDensity;

                // Green component
                rgba[indexOrigin+1] = 137 * floatDensity;

                // Blue component
                rgba[indexOrigin+2] = 82 * floatDensity;
            }
            else if (floatDensity >= 0.60)
            {
                // Red component
                rgba[indexOrigin] = 253 * floatDensity;

                // Green component
                rgba[indexOrigin+1] = 192 * floatDensity;

                // Blue component
                rgba[indexOrigin+2] = 62 * floatDensity;
            }
            else if (floatDensity >= 0.45)
            {
                // Red component
                rgba[indexOrigin] = 255 * floatDensity;

                // Green component
                rgba[indexOrigin+1] = 216 * floatDensity;

                // Blue component
                rgba[indexOrigin+2] = 22 * floatDensity;
            }
            else if (floatDensity >= 0.30)
            {

                // Red component
                rgba[indexOrigin] = 255 * floatDensity;

                // Green component
                rgba[indexOrigin+1] = 237 * floatDensity;

                // Blue component
                rgba[indexOrigin+2] = 56 * floatDensity;
            }
            else
            {
                // Red component
                rgba[indexOrigin] = 244 * floatDensity;

                // Green component
                rgba[indexOrigin+1] = 226 * floatDensity;

                // Blue component
                rgba[indexOrigin+2] = 135 * floatDensity;
            }

            rgba[indexOrigin+3] = floatDensity * 255;


Failed to install VS Code update.

VSCode Version:1.23.1
OS Version: Windows 10 Pro 64 bit

This issue has been happening for a long time. I've had to update but the update failed again and again.
Steps to Reproduce:
1.Click the gear icon at the bottom left
2.Click "Restart to update..."
3.VSCode closes itself, and the small window with text "Updating VS Code" appears
4.Following prompt appears
image

vscode-inno-updater-1546478047.log
Once I click "确定"(OK)， after a short while, this prompt appears.

I had a similar issue. The reason is because the installer thinks your code.exe is installed in
"C:\Users<user name>\AppData\Local\Programs\Microsoft VS Code\Code.exe" but mine was installed in C:\VisualStudioCode\Code.exe
So I had to update all my registry entries that pointed to the wrong location to fix this.
Is there an easier way to set the install location for code.exe so the updater know where to look?


Recognize nogil() arguments in pure python mode

Fixes #5113.

@matusvalo, could you try to get this fixed up? It would be nice to have this included in the final release.

@matusvalo, could you try to get this fixed up? It would be nice to have this included in the final release.

Yes, I tried to had a look multiple times but I have failed to find enough time for that

@scoder I had another look in this PR and I did not like it because:

The return value of try_to_parse_directive() is changed and is not consistent - it returns value in all cases except gil/nogil when it returns Expression object
Point 1. causes issues in the code using this function because the code expects value not expression object. This would need adding additional hacks which I don't like
The PR breaks current behavior of @nogil/@gil decorators. In master we raise an error for @nogil(1 == 0) but this PR silently ignores this case.

I have created alternative way how to implement this feature - see https://github.com/cython/cython/pull/5491


ldap multiple urls

Issue submitter TODO list

[X] I've looked up my issue in FAQ
[X] I've searched for an already existing issues here
[X] I've tried running main-labeled docker image and the issue still persists there
[X] I'm running a supported version of the application which is listed here

Describe the bug (actual behavior)
when i give in conf ldap.urls with a list of ldap urls that doesn't work.
Expected behavior
must work with multiple urls else why put a "s" ;-)
Your installation details
App version: artifacts.kpn.org/provectuslabs/kafka-ui:latest
application.yml:
logging:
level:
root: INFO
com.provectus: TRACE
reactor.netty.http.server.AccessLog: INFO
org.springframework.security: INFO
auth:
type: LDAP
kafka:
clusters:
- properties:
enable.idempotence: false
ssl.endpoint.identification.algorithm: ""
spring:
ldap:
urls: "{{ ldaps }}"
base: "uid={0},{{ldap_user_base_dn}}"
admin-user: "{{ ldap_readonly_user }}"
admin-password: "{{ ldap_password }}"
user-filter-search-base: "{{ldap_user_base_dn}}"
user-filter-search-filter: "(uid={0})"
group-filter-search-base: "{{ ldap_group_base_dn }}"
rbac:
roles:
- name: support
  clusters:
    - Default
  subjects:
    - provider: ldap
      type: group
      value: {{ ldap_group_names[1] }}

  permissions:
    - resource: APPLICATIONCONFIG
      actions: all

    - resource: CLUSTERCONFIG
      actions: all

    - resource: TOPIC
      value: ".*"
      actions: all

    - resource: CONSUMER
      value: ".*"
      actions: all

    - resource: SCHEMA
      value: ".*"
      actions: all

    - resource: CONNECT
      value: ".*"
      actions: all

    - resource: KSQL
      actions: all

    - resource: ACL
      actions: all

Steps to reproduce
put in application.yml
spring:
ldap:
urls: "server1, server2"
Screenshots
No response
Logs
No response
Additional context
in https://github.com/kafbat/kafka-ui/blob/main/api/src/main/java/io/kafbat/ui/config/auth/LdapSecurityConfig.java
public LdapContextSource ldapContextSource() {
LdapContextSource ctx = new LdapContextSource();
ctx.setUrl(props.getUrls());
ctx.setUserDn(props.getAdminUser());
ctx.setPassword(props.getAdminPassword());
ctx.afterPropertiesSet();
return ctx;
}
we are setting "ctx.setUrl(props.getUrls());" but must be something like:
var ldapurls =props.getUrls().split(',');
if (ldapurls.length > 1) {
ctx.setUrls(ldapurls);
}
else {
ctx.setUrl(props.getUrls());
}
see https://docs.spring.io/spring-ldap/docs/1.3.x/apidocs/org/springframework/ldap/core/support/AbstractContextSource.html#setUrls(java.lang.String[])

@plouarn can you try supplying a space-separated list of URLs instead?


Changes to cache json files and use gnu parallel to run multiple instances of genomicsdb_query

Note that TILEDB_CACHE support for bookkeeping files needs this PR - https://github.com/datma-health/TileDB/pull/177 to be merged.
Introduced a new tool genomicsdb_cache to cache the json files locally before invoking genomicsdb_query. Also added option to genomicsdb_query - --list-partitions to list the available partitions(with associated GenomicsDB arrays) to help the user figure out suitable intervals for query.

Will be opening a new PR for arrow output and expanding output_type to include all json modes.


Interchange integration

Description
Provide a brief description of the PR's purpose here.
Todos
Notable points that this PR has either accomplished or will accomplish.

[ ] TODO 1

Questions

[ ] Question1

Status

[ ] Ready to go

Superceded by #53


Move combobox to creation page.

Wait for merge of #354

closes #322
#339 should be ready to merge after merging


Enzo command update

the create new function looks outdated

Make sure every command is outputing what it is creating


Update develop rake task to hack

https://github.com/bullet-train-co/bullet_train-core/pull/265

@jagthedrummer Nope, this one's good to go :rocket:


Allow use of multiple data output formats

Currently, it is not possible store data in disk and index pages to Elasticsearch simultaneously. It would be good to have the ability to output data to multiple sources, so a single crawling process would allow:

Store data in disk for archival
Index data in Elasticsearch
Forward data to some queue (like Kafka) for downstream processing (in future)

Fixed in commit 19c944c15e1dc52892e032eb46720c5cafdcf9a7.


Implement newUntitled

Implement the newUntitled method.
I am reusing the same pattern as the classic JupyterLab file browser where new folders are name Untitled Folder {N} and new files are named untitled{N}.{ext}

I see an issue when creating an untitled folder, it gets created properly but JupyterLab seems to be trying to select it in the browser UI before refreshing

I see an issue when creating an untitled folder, it gets created properly but JupyterLab seems to be trying to select it in the browser UI before refreshing

This actually was an issue with the get output where the directory name was not right, resulting in JupyterLab trying to select a directory that does not exist.
This should be good to go now!@

Making a 0.3.0 release with this.


change ISO-dates to german date formatting

run through all dates and if written date is of format YYYY-MM-DD change to DD.MM.YYYY

fixed in 30d02cab01ce4788fb49af5deed736d11ea05a12


Raise static addresses quota on Travis testing account?

One of the causes of flaky tests in this repo appears to be exceeding a quota of global static IP addresses. A representative failure is at https://travis-ci.org/GoogleCloudPlatform/google-cloud-java/jobs/218519105. It looks like any individual test is fine, but if there are enough concurrent tests running, then the account runs out of quota. The test is failing at ITComputeTest.java#L783
Two options I can see to improve this:

Limit concurrent builds to some number (maybe 7?) https://docs.travis-ci.com/user/customizing-the-build#Limiting-Concurrent-Builds
Raise the quota on the testing account to have a much larger number of global static IP's available.

@michaelbausor could you raise the quota?

I went ahead and:

deleted the static addresses that had accumulated (15-ish of them)
raised the quota from 30 to 60

Also, a recent commit by Neo to ensure compute resources are cleaned up on test failure should help prevent this in the future.


Rate limiting breaks annotation UI

Actions before raising this issue

[X] I searched the existing issues and did not find anything similar.
[X] I read/searched the docs

Steps to Reproduce
This is not exactly a reproducer, just what I did to "break" the server :)

Upload 19 4k .png files to a project.
Annotate ~7 of them.
Be unable to move to remaining ones.

Expected Behavior
Everything works by default :)
Possible Solution
No response
Context
Hey team, I am stuck with a uvicorn error when trying to annotate images, here is a line from cvat-backend logs:
2024-12-09 18:43:25,606 DEBG 'uvicorn-0' stdout output:
INFO:     <IP_ADDRESS>:0 - "GET /api/jobs/1/data?org=&quality=compressed&type=chunk&index=0 HTTP/1.0" 429 Too Many Requests

I am not sure why there are too many requests to be honest, I am just a single user trying to annotate pictures through the UI.
Environment
Using provided Helm chart from 12eec5481bb3d4e6219bb8214df524f27b3037e3.

Since 2.23.0 main server processes does not prepare data chunks anymore. The process is done in dedicated workers.
Make sure you have at least one active pod cvat_worker_chunks.
It is not really intuitive, hovewer in this specific case the code means, that this worker was not able to prepare chunk in one minute. It may refer to different things (you do not have such workers or all these workers are busy).
That approach was chosen to keep API compatibility.

Related https://github.com/cvat-ai/cvat/issues/8781

May be there is something useful in pod logs?

Not really, but then again I would not know which pod is important for this (the chunks one only has this traceback repeated over and over again, the server only the 429 and some 200 responses, others also do not seem to have important clues).
I switched to v2.22.0 though, it seems to work, lol.

Hi team,
I’m encountering a similar issue when trying to annotate images in CVAT, and I wanted to share my experience and findings.
Actions Before Raising This Issue
I searched through existing issues and did not find anything similar.
I reviewed the documentation for any relevant information.
Steps to Reproduce
While this isn't a strict reproducer, here’s what I did that led to the issue:
Uploaded 19 4K .png files to a project.
Annotated approximately 7 of them.
Found myself unable to move to the remaining images.
Expected Behavior
I expected everything to work seamlessly by default.

Context
I am facing a uvicorn error when trying to annotate images.
Environment
I’m using the provided Helm chart from commit 12eec5481bb3d4e6219bb8214df524f27b3037e3.
Additional Information
I noticed that since version 2.23.0, the main server processes no longer prepare data chunks; this is now handled by dedicated workers. I made sure that at least one cvat_worker_chunks pod is active, but it seems that the worker is unable to prepare chunks in a timely manner, possibly due to being busy or not existing.
I also encountered a PermissionError in the cvat-backend-worker-chunks logs, indicating that it cannot create directories due to permission issues:
Verify
Open In Editor
Run
Copy code
PermissionError: [Errno 13] Permission denied: '/home/django/data/cache/events'

After reinstalling the chart and removing all volume claims and the namespace in Kubernetes, I still see these errors. I even tried setting the access modes to ReadWriteMany for the cvat-kvrocks-data and cvat-backend-data PVCs, but that did not resolve the issue.
I switched back to version 2.22.0, and it seems to work without these problems.
If anyone has insights or suggestions on how to resolve this, I would greatly appreciate it. Thank you for your help!
Best,
Sowmithri Sriram.
sriramsowmithri9807 --> github


possibility to add/install 'fluent-plugin-grok-parser' plugin in the elasticsearch version

Is there any possibility to add/install 'fluent-plugin-grok-parser' plugin in the elasticsearch version ?

Did you find a solution ? I'd like to add it too in fluent/fluentd-kubernetes-daemonset:elasticsearch

Looks like the only way is to fork this repo and change the appropriate Gemfile and build it yourself.

Another way is sending a patch :)


Fixing detection of Athlon II X2 B24 WIP

I guess, like my X4, this AMD series must be treated as a K8
Opteron, leaving Phenom (hybrid) as a rare case of K10.
Signed-off-by: Álvaro Jurado<EMAIL_ADDRESS>

I tried this to boot with -cpu host (this is the closest I can get to the real CPU), but unfortunately it does not help.
I get:
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 0]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 1]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 2]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 3]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 4]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 5]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 6]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 7]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 8]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 9]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 12]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 13]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 14]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 15]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 16]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 17]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 23]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 24]
Harvey
die:dumpregs
Anything that I can help with? Can I run something on Linux that gives you the necessary information?
Thanks.
PS I think the problem was in the typo with the word AuthenticAMD (see the attached file)
amd.diff.txt
Once I fixed the typo I was able to boot with -cpu host.
Hope this helps.

That was so because it failed getting the string. But perhaps in past it was wrong in another part. Ok, I'll review that part. Thanks!

Seems that strings are ok, but a bit outdated (both, Intel and AMD). So I'll add a check for newer strings from cpuid. GenuineIntel and AuthenticAMD. Maybe one day, vendors decided "why don't we put the right name in the cpus?", who knows...

Please test updated patch to see if it works for you.  Now Harvey checks both.
Thanks!

don't submit until you resolve the questions around the memcmp.

Ok, so only the second one. I'll fix it later.

Another round. Cleaner.

LGTM

Strange, I cannot boot with this file. Was the previous commit (d94d19f291ce735810c2d01e23520d9adc919e99) kept somewhere? Where I changed the CPU string and it worked for me?
Thanks

could you get us the output so we can see what's going on

Actually Github found the file/commit (it is referenced from my message). Will try it again and post the output.

Humm the other way would be reordering string, but seems @dmgolubovsky's cpu has the right registers order. Weird. Just look around internet. I could do an check and force the string with an if in AMD part of the func. Intel surely follows its own rules with ebx edx ecx without exception as is documented.

My doubt is:
Should I restore ebx-ecx-edx and reorder the string, being that 100% of intel cpus are ebx-edx-ecx and around 99% of AMD?,
or leave them just now it is, reminding it for other archs (RISCV and aarch64) what should implement its own cpuid asm func, and check if with vendor order ebx-edx-ecx the string is bad and force it with and "if" to put it in line with the rest of the world?.
Also, I could do the check if/force only for the CPUID 100F63 for this kind of Athlon II X2 B24 in line "case 100f60:" of cpuidhz().
What do you think?

Or restore cpuidamd64.S and reorder both strings before the memcmp's.  The precedent suggestion has the advantage of we could know what family of processors has what order of registers for cpuid.

As I read in:
https://en.wikipedia.org/wiki/CPUID
The order is right now:
movl	%ebx,0(%rsp)
movl	%edx,4(%rsp)
movl	%ecx,8(%rsp)

It's weird that a cpu x86 type has ebx-ecx-edx
Apple (BSD) just reorders the array after cpuid execution:
http://osxbook.com/book/bonus/misc/cpuinfo_x86/cpuinfo_x86.c
/* Get vendor */
do_cpuid(0, cpuid_reg);
bcopy((char *)&cpuid_reg[ebx], &info_p->cpuid_vendor[0], 4); /* ug */
bcopy((char *)&cpuid_reg[ecx], &info_p->cpuid_vendor[8], 4);
bcopy((char *)&cpuid_reg[edx], &info_p->cpuid_vendor[4], 4);

Another parts:
http://www.hugi.scene.org/online/coding/hugi 16 - corawhd4.htm
;Get VendorID
     mov eax,0
     CPUID                     ;CPUID!
     mov [edi+0],eax           ;max standard level supported
     add edi,4
     mov [edi+0],ebx
     mov [edi+4],edx
     mov [edi+8],ecx
     mov [edi+12],byte 0       ;vendor ID string+padding

     add edi,16

I can't believe you could have a cpu with different reg order.

I think your kvm/qemu version is playing with us.

I applied this fix on top of my v9p (virtio drivers in progress) branch. Still cannot boot. But I uncommented the debug print in archamd64.c and see this:
With kvm -cpu host:
Harvey
CPUID Vendor: AuthenticAMD�_�����ǯ������_���������
CPUID Signature: 0x00100f62
die:dumpregs
which after masking should match
0x00100f60:                /* K8 Athlon II X2 */
If I make the CPU string comparison fail (like it was before the fix) I get with -cpu host
Harvey
CPUID Vendor: AuthenticAMD�_�����ǯ������_���������
CPUID Signature: 0x00100f62
mmuinit: vmstart 0xfffffffff0000000 vmunused 0xfffffffff0713000 vmunmapped 0xfffffffff0800000 vmend 0xfffffffff4000000
sys->pd 0x108003 0x108023
cpu0: mmu l3 pte 0xfffffffff0106ff8 = 107023
cpu0: mmu l2 pte 0xfffffffff0107ff8 = 108023
cpu0: mmu l1 pte 0xfffffffff0108c00 = e3
cpu0: mmu l1 pte 0xfffffffff0108c00 = e3
base 0xfffffffff0af9000 ptr 0xfffffffff0af9000 nunits 3475201
allocated
free ok
parsexsdt: tbl fffffffff0afb04c, end 16
ACPI initialized
acpiinit();
physalloc color=0 base=0x4000000 size=0x7bfe0000
before mpsinit: acpionly 1, maxcores 1024
before mpacpi, maxcores 1024
APIC lapic paddr 0xfee00000, flags 0x00000001
ASlapic 0
apic proc 0/0 apicid 0
ASioapic 0
ioapic 0 addr fec00000 ibase 0
apic0: hz 668427820 max 6684278 min 66842 div 3
acpi_make_rdt(0x5ffff00 1 255 0x4)
interrupt 11 -> 13 ... Success
interrupt 10 -> 12 ... Success
interrupt 10 -> 12 ... Success
interrupt 11 -> 13 ... Success
interrupt 11 -> 13 ... Success
interrupt 10 -> 12 ... Success
interrupt 10 -> 12 ... Success
interrupt 11 -> 13 ... Success
bus dev type vid  did intl memory
0   0/0 06 00 00 8086 1237 A   0
0   1/0 06 01 00 8086 7000 A   0
0   1/1 01 01 80 8086 7010 A   0  4:0000c2a1 16
0   1/3 06 80 00 8086 7113 B   9
0   2/0 03 00 00 1b36 0100 B  10  0:f4000000 67108864 1:f8000000 67108864 2:fc090000 8192 3:0000c201 32
0   3/0 02 00 00 10ec 8139 B  11  0:0000c001 256 1:fc092000 256
0   4/0 02 00 00 1af4 1000 B  13  0:0000c221 32 1:fc093000 4096
0   5/0 00 02 00 1af4 1009 B  12  0:0000c101 64 1:fc094000 4096
0   6/0 00 02 00 1af4 1009 B  12  0:0000c141 64 1:fc095000 4096
0   7/0 07 80 00 1af4 1003 B  13  0:0000c241 32 1:fc096000 4096
0   8/0 01 00 00 1af4 1004 B  13  0:0000c181 64 1:fc097000 4096
0   9/0 01 00 00 1af4 1001 B  12  0:0000c1c1 64 1:fc098000 4096
0  10/0 00 ff 00 1af4 1005 B  12  0:0000c261 32
0  11/0 00 ff 00 1af4 1002 B  13  0:0000c281 32
acpi_make_rdt(0x5ffff00 12 255 0x30)
acpi_make_rdt(0xc001800 11 0 0xc)
#l0: rtl8139: 100Mbps port 0xc000 irq 11 tu 1514:<PHONE_NUMBER>56
getpgszi: size 0x200000 not found
panic: cpu0: newseg: getpgszi 2097152
die:wait forever
So it goes a bit further and dies. Perhaps because none of CPU features were processed properly.
Going back to my branch v9p.
With -cpu host: die:dumpregs (right away).
With -cpu pentium: boots.
With -cpu kvm64: boots.
Switched to master, pulled the latest updates.
With -cpu host: die:dumpregs (right away).
With -cpu pentium: boots.
With -cpu kvm64: boots.
But when I uncommented CPU string output in master, I got AuthcAMDenti (BTW it outputs so even with -cpu pentium). CPUID for "pentium" is 0x00000543. I'm afraid that in the KVM mode there is not much done to emulate "other than host" CPU.
That's all I got right now. Hope this helps.
Thanks

Ok, I have to restore cpuidamd64.S to the original order of registers. In Harvey, cpuid function takes three arguments and not only gets vendor id, it gets extended features too. Usually this is done in two different functions in other OSes.
In order to avoid the lack of having two almost equal functions, it's better to have cpuid getting 3 args and reorder the vendor id string in C in archamd64.c a la BSD.
Ron was in right, I'll do a cpuidname func which returns vendor id in right format and then passing it to cpuidhz for checkings.

My doubt is in archamd64.c:33 (cpuidinit)
if(memcmp(&machp()->CPU.cpuinfo[0][1], "GenuntelineI", 12) == 0)
		machp()->CPU.isintelcpu = 1;

I think that check is old and hasn't any sense if later it will check if it's AMD or Intel. I'll move CPU.isintelcpu = 1 to the right part of Intel checks in cpuidhz unless I found in other parts of the kernel source that feature was used (and where and why). In cpuidinit I can't pass an array element directly or pointer to vendor id string because it will be run from machp(). That's why I think it's better putting it out of there.

I'll upgrade the branch too.
Thanks @dmgolubovsky .

Please, test the last patch with new cpuidname function. If it still gives you and error, I could add another "if" with a tautologic vendorid == "AuthenticAMD" for cases in what hypervisors has a bug in reg order or anything.
@rminnich I'm sure you will see many things suitable of optimization here, feel free of crush me unmercifully :-)

If it works for all of you, let's do it.
I'll let someone else LGTM who can test it :=)

Let's wait for @dmgolubovsky tests. I'll clean the code and add strdup if all goes well.

Does not boot with -cpu host:
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 0]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 1]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 2]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 3]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 4]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 5]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 6]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 7]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 8]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 9]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 12]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 13]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 14]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 15]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 16]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 17]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 23]
warning: host doesn't support requested feature: CPUID.80000001H:EDX [bit 24]
Harvey
CPUID Vendor: AuthcAMDenti�_�����9�������_�����q���
vendorid: AuthenticAMD
CPUID Signature: 1052514
die:dumpregs
Boots with -cpu kvm64 and -cpu pentium
Printing CPUID information I think is a good idea (maybe CPUID signature could be printed in hex).
So, just like before. BTW where do these strings "host doesn't support..." come from? I cannot find them in the sources.
Just in case, my KVM version (under Ubuntu 16.04):
kvm -version
QEMU emulator version 2.5.0 (Debian 1:2.5+dfsg-5ubuntu10.4), Copyright (c) 2003-2008 Fabrice Bellard

Seems rare, because that CPUID signature 1052514 should be an AMD Athlon(tm) II X2 215 Processor and it falls into 100F62 see 1052514  here and Athlon II X2 215 specifications here , but I'll try your suggestion. In comment I'll write "weird kvm".

no you're right I typed it wrong.
I think we need to see a uname -a for that cpu. There's something weird going on here.
But it's not a harvey problem at this point I think.

IOW you already cover the case, you don't need more. It looks to me like a problem in the system in question.

I think strdup in final else in cpuidname() will resolv this case definitevely bypassing weird hypervisors issue.

Ok, @dmgolubovsky : this should solve the issue. Please, last test.
Thanks for your patience.

If cpu is now not recognized, cpuidhz will return 0, then in archhz, it will fall here:
iprint("archhz, cpuidhz failed, going to i8254hz\n");
	return i8254hz(info0, info1);

Calculating speed through clock and going forward. I used a warning in cpuidhz which will notify us when we have an standard real cpu working and not recognized through cpuid (remember: not only the vendor, extended features too).

Same as before. Does not boot with -cpu host, boots with others. It seems that there is a problem in rdmsr:
Harvey
CPUID Vendor: AuthcAMDenti�_�������������_���������
vendorid: AuthenticAMD
CPUID Signature: 100f62
1die:dumpregs
Note "1" before die: it comes from the debug I added:
    else if(strcmp("AuthenticAMD",vendorid) == 0){
            switch(info1[0] & 0x0fff0ff0){
            default:

DBG("0");
return 0;
case 0x00050ff0:                /* K8 Athlon Venice 64 / Qemu64 /
case 0x00020fc0:                / K8 Athlon Lima 64 /
case 0x00000f50:                / K8 Opteron 2xxx /
case 0x00100f60:                / K8 Athlon II X2 /
DBG("1");
msr = rdmsr(0xc0010042);
DBG("2");
r = (msr>>16) & 0x3f;
hz = 200000000ULL(4 * 2 + r)/2;
break;
We see 1 but do not see 2.
uname -a as requested:
uname -a
Linux hpcompaq 4.4.0-36-generic #55-Ubuntu SMP Thu Aug 11 18:01:55 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
And link to cpuinfo:
https://github.com/Harvey-OS/harvey/files/440495/cpuinfo.amd.txt
Hope this helps.
Thanks.

your environment can't be right.
The cpuid is returning the string for an amd. It's claiming it's type 100f62.Yet you can't read that msr?
OK, next step.
run your qemu -s -S. It will then wait for you to attach w/gdb. put a breakpoint at this function.
set what to display:
display/i $pc
Run until it is called, and step through the msr function:
stepi
and let's see what you get. Also, boot linux with -cpu host and use the rdmsr command:
rdmsr 0xc0010042
and let us know what that returns. I don't trust your kvm any more :-)

Try moving case f60 to just before 100f90. Maybe I'm wrong and that kind of cpu needa rdmsr to 064. And tell me the result. Or you can use gdb as Ron says.

I would really like to see the result of booting linux on that kvm with -cpu host and do the rdmsr command.

Moving case f60 did not help, dies on rdmsr same way. I tried to run rdmsr on the host: it says "file not found", and I see from strace that it tries to read /dev/cpu/0/msr, but there is only /dev/cpu/microcode.
Too old CPU? The computer was made in 2010 tol my knowledge.
Linux (coreOS) boots fine with CPU=host (but there is no /dev/cpu at all, will setup something else to see). But absence of /dev/cpu/0 on the host makes me think that perhaps I just need to use -cpu kvm64...
Thanks.

No, I don't think so. I think that kvm with -cpu host has some bug. Any way, that "file not found" could be happening due to a buggy version of msr-tools in linux (for instance), not the cpu itself. But, it's clear that Harvey recognizes an AMD cpu. I'm pretty sure that only two address can be asked about cpuid, and those what use ending in 42 comes from 2007. K10 and hybrids uses address ending 64. There's no other possibility unless cpu couldn't be recognized as AMD or Intel (third limit case), in whose case it will fall in a clock calculation routine. But never could hang the boot. I checked Athlox II X2 and its 100f60 case is in right place (look at NxM sources, for instance), when I implemented cpuidhz a year ago after my ThinkPad was failing due to wrong functions for Intel, maybe I thought Athlon II X2 was like a Phenom, but now it's right. More... I'm pretty sure that PR looks as it must look.
At the begining your kvm -cpu host was being recognized as AMD and hanging, when you changed the vendor string to right order, it didn't recognize the CPU due to ebx-ecx-edx wrong order in our asm, and jumped into archhz clock calculation. When I made the subsequent fixes, CPU was always being recognized at any case (right regs order, cpuidname func...) and, then, hanging all the time since that. The advantage is that now we have a better process to do all of this, but if your kvm -cpu host is well recognized it hangs. Look and think about all made until now.
In my ThinkPad L420, if I boot kvm with -cpu Phenom it sees my real Intel. If I boot with -cpu -host it sees my real Intel, no matter what I could do, it always sees an Intel. So, If you use kvm paravirtualizer, don't try to lie to the machine and let it boot with an Intel. Otherwise, don't use kvm. Just qemu alone.
What if you just try kvm without -cpu option? does it fails too? If not, fine. If yes, just use kvm64. Important part is your virtio work and Harvey working. Not resolving possible kvm bugs. I'm saying this because the last year and half, we entered in deep debugging process due to qemu bugs. One of them breaking SMP at early days, for example.

I think we could merge this, anyway.

OK from me to merge. You are right, I cannot pretend it is an Intel when real host is AMD (I mentioned that earlier). Thanks for your efforts.

Thanks for your patience. Let's go back to virtio. It will open many doors :-).
And think that at the end, we have better routines to detect cpu's. It wasn't a waste of time.

Right. Virtio needs to fix the multiple mouse interrupts first, and the interrupt table allocation second. I'm going to look into this tonight (need some time to learn ACPI/APIC stuff - hope to hear from Ron as well). The merge button seems available to me - can I do it, or will you?

I asked Ron about last details here. When he told me about, I'll merge this.
Thanks!

typically, with linux, to read msrs, you first do
modprobe msr
and then the rdmsr command. rdmsr has worked on linux for 15 years so I doubt your machine is too old.

LGTM

OK, modprobe msr helped (I thought this module was loaded)
On the host:
sudo rdmsr 0xc0010042
rdmsr: CPU 0 cannot read MSR 0xc0010042
sudo rdmsr 0xc0010064
800001e13c00140e
This was on the host.
On a guest (Fedora 24 running on kvm -cpu host, cpuinfo shows the same model as host):
cannot copy-paste, but it says "cannot read msr 0xc0010064"
Consistent to some degree. rdmsr works on the host, but not in the guest.
So perhaps a bug in KVM, somehow Linux works around that.
Thanks.

This kind of confirms it: looks like a kvm bug. Thanks for working on this.

linux probably works around it because they have rdmsr_safe, which returns an error, not a panic :-)
I think we need that. Later.

Merged at Alvaro's request.


docs: remove webpack constant build issue "fix" on storybook

Purpose
There was an issue with webpack and Storybook, that was causing a constant build when running in development mode.
It was "fixed" in https://github.com/onfido/castor/pull/554.
However, now with upcoming Storybook v6.3 it will be fixed, and such is no longer needed.
Approach
Remove the "fix".
Testing
Only after Storybook v6.3 upgrade.
Risks
N/A

We could later experiment with the Storybook Vite builder, should make it much faster
https://storybook.js.org/blog/storybook-for-vite


Remove FoW  Dependencies from Loadouts

Replaced FoW Equipment and Weapons to IFA for Loadouts:
UK 40 and UK 44
US 42 and US 44
USAB 42 and USAB 44
USMC 42 and USMC 44

Will wait with review until new Project has been made for upcoming rework that these changes are a part of.


Add resharper support

Could you provide a link? Looking at @brantb 's repo, I can't find anything about ReSharper.

Hi @joce, ReSharper support has been merged into this repo (pull request #3).
However please be aware that this project is no longer actively maintained. ReSharper support is probably incomplete with newer versions. I still accept pull requests if you want to contribute.


Out of sync issues with deleted spectra (files) and spectral datasets

When you delete uploaded studies and then you cancel the deletion, they appear deleted or not deleted in different places of the project.
To reproduce:

Submit a project
Go to manage studies
delete a dataset
Cancel
Go to the study view
You will find the deleted spectrum in the list of "select spectra" (expected behavior as we canceled the deletion)
Go to the files tab, you will not find the deleted spectrum there (unexpected behavior as we canceled the deletion)

screen-capture (2).webm

No longer relevant. Closing this now.


Fix array value

Hello,
first, many thanks for your good documents.
In 'Ch2_MorePyMC_PyMC3.ipynb', I modified a part of the code from
samples = [lambda_1.random()[0] for i in range(20000)]

to
samples = [lambda_1.random().flat[0] for i in range(20000)]

lambda_1.random() return "array(value)" and the shape is (), so lambda_1.random()[0] generate an error("too many indices for array") in original code.
So, I modified the code to change the value type from "numpy.ndarray" to "numpy.float64" by using flat[0].

postscript
I modified it again
samples = lambda_1.random(size=20000)

+1. I was about to submit a PR for the same issue. I fixed it slightly differently:
samples = [lambda_1.random().item() for i in range(20000)]
Can also be:
samples = [lambda_1.random().item(0) for i in range(20000)]
However, 0 is the default value if None is passed to item(). What I don't quite follow is why the usual Python indexing syntax doesn't work. This might only be an issue with certain platforms.


Fix background when using appWaitPkg/Activity

When app is started using an activity but redirects to another one (or
another package) one may use appWaitPackage or appWaitActivity either
as capabilities which will be used during the initial launch, or as parameters
of the startActivity command.
Using the background command in such circumstances would lead to ADB
permission denial error (activity is not exported).
This PR fixes that issue when:

the activity is the original session activity (launchApp command)
the app was started using startActivity command

Thanks a lot for the reviews !
I've updated the code to add parenthesis and make sure we don't crash if appWaitActivity is undefined.
Let me know if that's ok for you.

Thanks again for your advices, should I squash the last 2 commits ?

nah, lets wait for CI resulsts


[New Feature]: player hover  the line change color according player theme.

🎮 feature Request
when hover the user color is gray is too confusing which turn.
Point down the features

when player hover the indicator change color
whenever any player turn ,like Player 1's turn button color is pink , whenever he click on horizontal , vertical indicator those are hover its player color .

Select program in which you are contributing
GSSoC24
Code of Conduct

[X] I follow CONTRIBUTING GUIDELINE of this project.

Hello ,can you please assign this task to me


Number problems

This might be my lack of understanding of array buffers etc, but I'm struggling to get a schema that works consistently for numbers with decimal points.
I have tried with int32 and float32s, with digits set to 4.
However, when using int32, certain values cause subsequent objects in the state to not encode/decode correctly.
To explain my intention, I want to be able to send number coordinates within a range of about -60k to +60k, with accuracy to at least 2 decimal places, but 4 ideally.
Example of failing test:
describe('stuff', () => {
  it('decodes state correctly', () => {
    // Note: in the schema, x is an int32 with 4 digits
    const gameState: GameState = {
      players: [
        { id: '1', x: 0.9 },
        { id: '2', x: -4.475 },
      ]
    }

    const buffer = mainModel.toBuffer(gameState);
    const decoded = mainModel.fromBuffer(buffer);

    expect(decoded.players[0].x).toEqual(0.9); // passes
    expect(decoded.players[1]).toBeDefined(); // fails
  })
})

If x is 0.93, 1, or most other values, it works and both players are decoded correctly, but not if you set it to 0.91 or 0.92.
In the case where the test fails, player 1 is decoded correctly, but player 2 doesn't exist at all.
I find this very confusing - it seems to work more consistently with float32 instead of int32, but then with floats, the numbers don't always round accurately. Do you have any advice to use for this situation?

Can you please share your model?

Hi, this is the full schema I used (only showed 'x' in my example above to simplify the code).
const playerSchema = BufferSchema.schema('player', {
  id: { type: string8, length: 16 },
  name: { type: string8, length: 16 },
  x: { type: int32, digits: 4 },
  y: { type: float32, digits: 4 },
  z: { type: float32, digits: 4 },
  rot: { type: float32, digits: 4 },
});

export const mainSchema = BufferSchema.schema('snapshot', {
  players: [playerSchema],
});

export const mainModel = new Model(mainSchema);

This was clearly a bug. I have fixed it in da0a0f62db0bd10262361698a4b3f5c92d8cbc70. I will publish it to npm within the next minutes.
Can you test it and give me a feedback?

Hi, can confirm my cases are fixed now! thanks for the update.

You're welcome :)


[Feature] New JFXTextField type (Outlined Text Field)

https://material.io/design/components/text-fields.html#outlined-text-field

Now we should also overhaul TextField to new standard.
https://material.io/design/components/text-fields.html
Demo:
https://material-components.github.io/material-components-web-catalog/#/component/text-field?type=filled


Day night map

This app displays a world map with the night portion shaded in.  It can optionally also show the time and/or the date.

This is really cool!


don't use shared state in InsertFromValuesAnalyzer / CopyStatementAnalyzer

caused validation error if requests are made concurrently

ack


Is there anyway to use Onesignal with this plugin together ?

Hi i am currently implementing Onesignal into my project which uses service worker to allow push notification in browser. But the problem is, Onesignal keep overwriting my current app service worker. Is there any way to allow Onesignal to use together with this plugin ?

Sorry, OneSignal is a tool which sells your users information to third-parties so you're able to use it for free. Even if it's somehow possible to use OneSignal with this plugin, I wouldn't support such feature.


RuntimeError: CUDA error: the launch timed out and was terminated

Hi, I am trying to run an experiment with COCO-additional using this yaml configuration file: https://github.com/facebookresearch/unbiased-teacher/blob/main/configs/coco_additional/faster_rcnn_R_50_FPN_focal_cross_coco_unsupW2.yaml
Due to device limitations, I use only 2 GPUs (Tesla K80), each 12GB with 4 Batch-Size.
After the first round of train and evaluation, it stops with this error.
RuntimeError: CUDA error: the launch timed out and was terminated
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.

By using a GPU other than the Tesla K80 everything works properly


Jiangzaitoon has changed their URL

Source name
Jiangzaitoon
Source link
https://jiangzaitoon.info/
Source language
Turkish
Other details
NSFW = yes
Acknowledgements

[X] I have checked that the extension does not already exist by searching the extension listing and verified it does not appear there.
[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a meaningful title with the source name.
[ ] I have admitted that I am a clown by having checked this box, as I have not read these acknowledgements.
[X] I will fill out all of the requested information in this form.

dude do i choose all the acknowledgements or not.. their domain has changed 💀


[Python] Non zero-copy of pa.table.to_pandas() for simple case

Describe the usage question you have. Please include as many useful details as  possible.
Why such very basic example throws
pyarrow.lib.ArrowInvalid: Cannot do zero copy conversion into multi-column DataFrame block?
table = pa.table({'a': [1, 2, 3]})
df = table.to_pandas(types_mapper=pd.ArrowDtype, zero_copy_only=True)

Versions of pandas and PyArrow are:
pd.__version__
'2.1.2'
pa.__version__
'14.0.1'

Dtypes of the result in case of zero_copy_only=False call
table = pa.table({'a': [1, 2, 3]})
df = table.to_pandas(types_mapper=pd.ArrowDtype, zero_copy_only=False)

are:
df.dtypes
a    int64[pyarrow]
dtype: object

Component(s)
Python

The zero_copy_only keyword hasn't really been made to work with types_mapper, so yes this can be seen as a wrong error message. However, it's also difficult to properly implement that, because pyarrow doesn't know if the type you pass to types_mapper will be able to convert zero-copy or not. (but the message about "multi-column DataFrame block" is certainly confusing)
Now, is there a reason you want to use this keyword? If you use types_mapper=pd.ArrowDtype, you have the guarantee that the conversions are zero-copy.

Thanks a lot!
My original logical chain was as follows:
I called
df = table.to_pandas(/* zero_copy_only=False*/)

checked df.dtypes and saw something like:
print(df.dtypes)
a    int64
dtype: object

I was weired since I expected that pa.table.to_pandas() with default params does the best to do not convert data to pandas 2.x types so I expected:
print(df.dtypes)
a    int64[arrow]
dtype: object

Next I decided to force PyArrow to keep types by types_mapper=pd.ArrowDtype and saw:
df = table.to_pandas(types_mapper=pd.ArrowDtype/*, zero_copy_only=False*/)
print(df.dtypes)
a    int64[arrow]
dtype: object

At the end I decided to double check that zero-copy is used by:
df = table.to_pandas(types_mapper=pd.ArrowDtype, zero_copy_only=True)

and got unexpected exception.
That is my user story :-)
Probably it is non-intuitive behaviour of pa.table.to_pandas(...). Or I skiped something in the documentation.
And you are right "multi-column DataFrame block" message is also confusing.

I was weired since I expected that pa.table.to_pandas() with default params does the best to do not convert data to pandas 2.x types so I expected:

Note that it actually did convert the data to the pandas 2.x data types, because "int64" is the default integer data type in pandas 2.0. The ArrowDtype you were expecting is only an experimental, opt-in data type.

At the end I decided to double check that zero-copy is used by:

Yeah, and so at that point using types_mapper with zero_copy_only=True doesn't really work well together, as explained in my previous post.
Short term you can of course just leave out the zero_copy_only=True.
On the pyarrow side, we should at least improve the error message, and maybe we could ignore the zero-copy keyword for columns that go through types_mapper (didn't look in detail how complex that would be).


JFXTextArea is always bold

Hi.
I just started using JFoenix and I like it a lot but I noticed that text inside JFXTextArea is always bold. It doesn't matter what font I use (I tested it on the default and on Open Sans). Here's screenshot comparing JFXTextArea and JFXTextField

Hi,
You need to change font weight in css as the following:
.jfx-text-area {
    -fx-font-weight: normal;
}

Yeah, that's the first thing I tried. It doesn't help


Implementing BREAK, CONTINUE

I fancy these would be quite useful. At least, I went looking to use something like this, found these unimplemented markers and had quite optimistic hopes dashed when I noticed:
// TODO: Handle BREAK or CONTINUE?

What would it entail? It looks like we'd probably have to recompute the stack from the adjacency list with instructions to skip a marked vertex. Right now, haven't drilled so far down to know how difficult this might be.

I'm not really sure how these two different results should be handled and how they differ.
Given that QUIT already terminates the overall execution of the plasm,
I would expect that on BREAK the current iteration through the plasm is aborted
and execute resets the stack counter and continues with the next iteration of the plasm.
Actually, this is a behavior I miss in ecto quite a bit.
Is this behavior reasonable/intended? If so, I would be happy to contribute a patch for the BREAK return code.

I do not know what the original authors intended - what is there right now seems like a stub for some original design plan.
Your proposal seems reasonable. Send a pull request and we can iterate on it there.
@vrabaud any thoughts?

For the purposes of clarity, I think we can define here:

BREAK - abort current graph execution, but if multiple executions have been scheduled, proceed with the next one immediately.
CONTINUE - abort the current cell and its subgraph, but otherwise continue with the current execution.


add reprocess functionality

First proposed by @EmCeBeh there is an idea for a better adjustment of the processing parameters (for example threshold value).
It would be quite useful to be add a reprocess function which will run the processing for the last capture series again with the fresh parameters and show the result in tango events.

It also can be useful to be able to limit the amount of captures in series to be processed in case of very very long capture series.


Any Suggestions

First, thanks so much for this wonderful work @hunterjm. This new program is pretty good and professional! But i think that this program can be better.
So, these are my suggestion:

Need features to set price manually. For some players, i win auction at 200 and that players can be sold for 2000 or higher. But i also have in list another player that need 90/100/110.

About rpm: i think is better have a function that automatically and randomly change the rpm about some range value. This for emulate a human behaviour. I think the better range is 4/8.

(Maybe this function already there automatically) auto stop the bid after a time can we set and resume after a time can we set.

If can add consumables and other object, this program can be perfect!

Sorry for my not-excellent english. Thank you! :)

I'll address these in the same order:

It's on the roadmap
We already vary the requests between 75% and 125% of the set RPM value.  You should see this reflected in the timestamps on the logs.
This is also on the roadmap
This is not currently on the roadmap.  I would need a good source to pull all of the consumable IDs and images from.  If you can help find something similar to EA Sports Database for consumables, I would be happy to add it.

thanks for the reply! for the n°4, futbin have a database of consumables. it's not perfect, but it's a begin.. the IDs maybe is a problem...

see #55, #58, and #57 for updates once work starts on these.


Adding data collection flexibility

Needs the n-way Cartesian product of possible configuration combinations as discussed in-person or adapts @colinhanrahan's idea in #46. Both are good ideas. Currently on the backburner to prioritize research paper writing.


Don't readWalletMeta while restoring

Issue Number

Overview

[x] Remove pointless readWalletMeta in restoreBlocks

Comments

Hope this fixes the restore bench (see commit message)

https://buildkite.com/input-output-hk/cardano-wallet-nightly/builds/809#e26d2361-279f-45fb-a473-7af1dcf17105

https://buildkite.com/input-output-hk/cardano-wallet-nightly/builds/809#e26d2361-279f-45fb-a473-7af1dcf17105

Closing as this didn't fix the restore bench.

Let's evict TimeInterpreter from the DB layer.

Agree — but don't think it's critical

Closing as this didn't fix the restore bench.

Let's evict TimeInterpreter from the DB layer.

Agree — but don't think it's critical


Feature: cache contents of base.js from identical urls

YouTube appears to serve base.js from the same URL pretty often. This should cut down on the number of requests we're making for the same resource when downloading more than a single video.

Coverage increased (+0.1%) to 87.154% when pulling 5bc4c325e3b55fdac2fd495c742f59772662f629 on billd100:Feature/Cache-contents-of-basejs-from-same-URLs into 3e8ab2b2fa721b7d6d7d00432f3c9eb817b9f902 on nficano:master.

solution is incompatible w/ python 2.7.


using navigation mode as file selector

usecase: i have to add several files (not from my working directoy) to my
current prompt, and I would like to use the navigation mode as file selector.
This is similar to how ranger --choosefiles=output.txt would work.
Currently, tab completion is not efficient as I would have type the full path for each file i want to add.
Wildcards or globs are not specific enough, because they could match files i dont want to add.
The insert-selected command in navigation mode would be ideal for this, except that:

navigation mode changes the current working directory of the shell
insert-selected inserts the filename, not the absolute or relative path

Can you add an option, or change default behaviour, such that:

either navigation-mode does not change the shells directory, or it returns to the starting directory when closing.
insert-selected inserts the path of the selected file, relative to the working directory or the absolute path.

I've implemented my above suggestion here, if there's interest in can turn it into a pull request.

I took a look at your commit. IIUC, it changes the behavior of the navigation mode so that dismissing it will navigate back to the original directory. This would make it impossible to use the navigation mode to navigate to a different directory, which is another valid use case.
I think it's best to approach this use case by introducing two variants navigation modes:

The current, "cd" variant: navigating changes working directory
The proposed "pick file" variant: navigating doesn't change working directory; inserting a filename inserts a path relative to the original working directory.

Yes, that is a good summary of my commit.
Two variants of the navigation mode would work for me; my thoughts on the 2 variants:

The current, "cd" variant: navigating changes working directory

I think this overlaps with the location mode, which I use to rapidly change directories (most of the time when i use cd).
When the directory is not in the directory list yet, typing cd and then using either completion or navigation to pick the directory, would be just as easy. If you want to keep the navigation mode simple (no two variants), i would prefer only the other variant.

The proposed "pick file" variant: navigating doesn't change working directory; inserting a filename inserts a path relative to the original working directory.

Sound good.
It would also make the preview window (the right most panel in the navigation mode) more useful. As you type a long command, and want to look up some text in a readme, you can do that in this variant without interfering with your prompt or changing directories.

The current, "cd" variant: navigating changes working directory

I think this overlaps with the location mode, which I use to rapidly change directories (most of the time when i use cd). When the directory is not in the directory list yet, typing cd and then using either completion or navigation to pick the directory, would be just as easy. If you want to keep the navigation mode simple (no two variants), i would prefer only the other variant.

These are both for changing directories, but the actual use case is quite different:

Location mode is for changing to a directory you have been to before.
Navigation mode, when used for changing directories, is for changing to a directory that's close to the current directory, and quite possibly one that you have never been to before.

So there is a need for the directory-changing variant of the navigation mode.
There are several ways to get both variants:

Support both variants in code.
Only support the non-directory-changing variant (your commit). The user can still get the directory-changing behavior by typing cd, invoke the navigation mode, and select the directory they wish to change to. However, this is more awkward than the current directory-changing navigation mode, because they need to navigate to the parent of the directory they want to go to, and select the directory. This also makes it impossible to change to /.
Only support the directory-changing variant (status quo). When #1299 is implemented, you can write an Elvish script that starts the navigation mode, and outputs the selected filename when the script terminates. Basically you use another Elvish process to implement ranger --choosefiles.

I feel it may actually make sense to support both variant in code - this doesn't depend on other work and doesn't change the user's workflow.


Use pg14-based timescaledb images in docker-compose

@cevian

Lets put this as a not in the changelog as a breaking change. People can't just switch to this docker compose from the old docker compose without manual intervention.

Technically they can. The docker-compose doesn't define volumes or volume mounts which would be reused over invocations of docker-compose, so changing the docker image shouldn't actually affect anything or anyone.


Make ASSET_NAME hardcoded

Looking at our usage of ASSET_NAME with trigger-a-release announcement is pretty much fixed across all repos. We are currently announcing using the repo name. Like corral, crypto, release-bot-action etc.
Except that it is a value we have to change in the workflow.
Given this, we should switch to using GITHUB_REPOSITORY for the value and not taking an ASSET_NAME.
This means that we can copy the workflow defintion without having to change it.
Additionally when we make so others can use, Announcement will be something like
ponylang/corral
So there's no namespacing issue and its very clear what is what.

I'm having 2nd thoughts on if it should be full GITHUB_REPOSITORY.
Perhaps just the last part like "corral".

Having 3rd thoughts. I think it should be the full repo.


Merge aliases that are over same value.

Fixes #58.
This improves both compile time and execution time.

Codecov Report

Merging #59 (c356a0b) into 0.6.0 (41c3843) will increase coverage by 0.04%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##            0.6.0      #59      +/-   ##
==========================================
+ Coverage   85.56%   85.61%   +0.04%
==========================================
  Files           9        9
  Lines         693      695       +2
==========================================
+ Hits          593      595       +2
  Misses        100      100

Impacted Files
Coverage Δ

word_filter_codegen/src/lib.rs
82.79% <100.00%> (+0.18%)
:arrow_up:

word_filter_codegen/src/pda.rs
88.20% <100.00%> (+0.06%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 41c3843...c356a0b. Read the comment docs.


REVERSE LINKED LIST

Added a C++ code where you can reverse a linked list by normal method or Recursion

Sorry to inform but this repository has been excluded from hacktoberfest. So inorder to make your PR count towards hacktoberfest, request you to make your contribution in this repository -> https://github.com/SR-Sunny-Raj/Hacktoberfest2022-for-all


save_location to saved_model_name/filename/url

@NMPowell99 Could you update the test_sdk_call__get_job_results__200 test to account for these new parts of the response? Right now the test passes properly because the expected and actual both have None values for the new fields added, but I think we want to update the test to include these as well.


Reprocess a DSR when a collection was added to be referenced before already-completed collection

Is your feature request related to a specific problem?
See Scenario D on the diagram on this page
In order to gain insight into error scenarios, we will be addressing https://github.com/ethyca/fidesops/issues/754 first.

Could be replaced with this design spike https://github.com/ethyca/fidesops/issues/1036, which would cover this scenario and other scenarios we're not handling


Fixing order of commands for prerequisites

Under the "Set up environment variables for Ansible Automation Controller" section:
Command "export CONTROLLER_VERIFY_SSL=no" needs to be run first in order to "export CONTROLLER_TOKEN=awx login | jq -r .token" work as well

/approve

/approve


Docker-Security-Patch - Changes to Dockerfile's to run as non-root user.

Jira Ticket
https://tools.hmcts.net/jira/browse/FACT-538
Change description

Change to Dockerfile to run as non root user as suggested by Fortify

Does this PR introduce a breaking change? (check one with "x")
[ ] Yes
[x] No

On further investigation, this is not needed due to the perms setup within the containers.
Warning has been resolved in Fortify and ITHC/Fortify teams are happy going forward. Closing this.


Explorer reporting different balance to wallet

Expected Behavior
Actual Behavior
Steps to Reproduce the Problem

Explorer shows a certain balance
In wallet balance for that address is different

Specifications

Version:
Platform:
Subsystem:

Having the same issue.

This has now been fixed with our new Carver2D Rev3 fork.


Some more Automation Script ideas

If anyone out of ideas, can pick from here 😀
Note 1: Ticked are picked or completed
Note 2: Create a issue with any idea to work on

[x] Calendar GUI
[x] PNG to jpg convertor
[x] Make image corners round
[x] Eye Detection
[x] Image to speech (voice)
[x] Morse code Translator
[ ] PPT to Video
[x] Tkinter Python GUI
[x] Subtitle Downloader
[x] CSV to excel
[x] CSV to JSON
[ ] Excel to CSV

hey @pawangeek , I would like to work on CSV to JSON
issue #693

Hi @pawangeek, how about images to gif?

@pawangeek Hey, u closed my issue, i dont know why, but could u make some other for me? i would like to work on something please, my last issue was #699

Here's Some Ideas:
[ ] Make a Python3 Bot to Auto Attend Google Meet / Zoom Classes
[ ] Make a Python3 Program to Scrape ratings for movies and TV Shows (Use Squid Game for example)
[ ] Make a Python3 Bot to generate cool images from shapes and gradients. (Possible NFT generator)
[ ] Make a Python3 WebUI for youtube-dl
[ ] Make a Python3 GUI for youtube-dl
[ ] Make a Python3 Anime List management tool
[ ] Make a Python3 Websocket Chat Server
[ ] Make a Python3 Raw TCP encrypted chat
[ ] Make a Python3 ARP packet spoofer
[ ] Make a Python3 ARP network scanner

@pawangeek Is there anything that I can work on in terms of stock data?