com.norconex.committer.core.Committer: Cannot index document batch to Solr

Hi,
I am seeing this error but my context field is set as text_general.

Any suggestion what I could do to fix the issue?
I understand the issue should be fixed but any way to ignore such errors so the rest of the batch does not fail?

I have attaced my scema file.
"possible analysis error: Document contains at least one immense term in field="content" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped.  Please correct the analyzer to not produce such terms.  The prefix of the first immense term is: '[66, 117, 108, 108, 101, 116, 105, 110, 32, 100, -30, -128, -103, 105, 110, 102, 111, 114, 109, 97, 116, 105, 111, 110, 32, -61, -87, 108, 101, 99]...', original message: bytes can be at most 32766 in length;"
schema.txt
Thanks

Are you tokenizing your content in your schema field definition or storing it as one long string?  If you are tokenizing and still have this (e.g., a long string without any spaces), you can truncate the value to force it in.  To do this, I suggest you have a look at TruncateTagger or SubstringTransformer and use the most appropriate one in your importer configuration section, as a post-parse handler.

I created a new core and used the same schema files and didn't have any problem indexing.  Thank you.


[docs] Verifying provenance with OPA

Docs on verifying provenance generated by the generic workflow with Open Policy Agent

Getting OPA working will likely require a good amount of work. I don't see any SLSA verification tools yet and we would want one that works with Kubernetes and ideally isn't a lot more maintenance work than the existing Kubernetes Admission Control integraitons like gatekeeper.
Some problems so solve:

implementation approach: add functionality to gatekeeper? or create a separate admission controller to verify SLSA provenance.
policy format: OPA works well for simple verification on JSON data, but we will want to allow verification on other supplementary data like the signing key's subject and other metadata.
policy packages: gatekeeper has several packages for making writing Kubernetes policies easier. Do we need anything like that?
flexibility: We would want to make it flexible enough that it can work with sigstore etc. outside of just this project. i.e. Building on something other than Github. How would this be different from the existing sigstore policy-controller?

Probably examples that use sigstore policy-controller with cue is a more practical goal for GA of the generic workflows.

Moving off the milestone since OPA doesn't have support for SLSA yet.


xWebVirtualDirectory WebApplication should not be mandatory

WebApplication parameter in xWebVirtualDirectory should not be mandatory

Hi @grubyrychu sorry for not following up on this sooner, I'll take a look at this and get back to you.

I'm seeing the same behavior with xWebVirtualDirectory. The WebApplication variable used in the PS cmdlet New-WebVirtualDirectory is optional.

Yeah I've been looking over the logic more recently, we should be able to change it. It may be some more time before I can cycle back to this, if anyone wants to submit a PR I would happily review it.

I'm not too confident with the proper DSC way to handle this item. Either set the parms to optional and include conditional logic or change all $WebApplication and $Application to allow nulls.
My quick fix looks like the following for each of the above parameters:
[parameter(Mandatory = $true)]
[AllowEmptyString()]
[System.String]
$WebApplication

IMO - we'd want to remove the mandatory = $true, as we're allowing empty strings, so why would I need to pass this at all?
It does mean it'd be a schema change (as it changes it from Key/Required to Write) - fortunately this isn't a breaking change.
We'd also need to change the logic where it tests for the existant of the application, as currently Test-ApplicationExists would return false (as an empty string wouldn't exist as an application) which means Get-CompositeName would return "/$Name" (empty string + /$Name) so we'd be creating virtual directories with an empty slash in the names ie: "Default Web Site//Test" which I'm not sure is allowed, nor is what we're actually looking for.
Just my thoughts.

@tysonjhayes  I think this is actually the right way to go. The $WebApplication parameter is optional, so we should not need to pass it.

In fact I am not sure that is the right solution.
The keys of the resource are Website, WebApplication, Name. If we remove WebApplication, it will remain only WebSite and Name, which is not enough to uniquely identify instances of the resource.
We could have two directories with the same name in two different applications of a web site.
The idea of @Xainey looks better : allow WebApplication to accept empty strings.

I just ran into this and it's currently preventing me from properly configuring my IIS sites which is quite frustrating. @tysonjhayes are you currently looking at this? If you're not, would you accept a pull request to fix it?

@CtrlC-Root - totally open to a PR on this! Thanks for offering!


New icon: Healthchecks

[x] I have carefully read and followed CONTRIBUTING document.

URL of the site:

https://github.com/healthchecks/healthchecks
https://healthchecks.io

Logo / icon info:

Logo source: https://healthchecks.io/static/img/logo-full.svg
Note: the logo on Healthchecks.io website is currently in Ukrainian flag colors. The above link is the regular, peace-time logo with a dark green background.
I used svg_template_generic.svg as a template, and cleaned up the final SVG by hand.

Background color info:

I used the same dark green background as in the official logo: #09311bff

Full disclosure: I'm the author and maintainer of Healthchecks open source project. I am also running a hosted service at healthchecks.io. The logo would be useful both for people self-hosting a Healthchecks instance, and the users of the hosted service.

One flaw that I fixed: logo wasn't compound pathed.
Otherwise ok 👍


Set up TailwindCSS for Vue

Description
Set up Tailwind for Vue to manage styling easier. If we have the time to do so with the current priorities, rewrite the Vue files currently using style scoped to use Tailwind. If not then let the team know and we'll leave that for a bit later.
To-do

[ ] Set up Tailwind
[ ] *Rewrite current CSS code into Tailwind

It has been determined that this issue cannot be completed within the remaining time. This issue will be closed.

Branch has been re-oped due to the need to add mobile compatibility to the styling.


DesktopLibrary recording

Fixes #151

Coverage decreased (-1.1%) to 98.856% when pulling 94f686cc8ed9670789dd47c265aa1bf6794bbd6b on screen_recording into 865459fc61b5d7090d09b2338021fdb7206a9969 on master.

Coverage decreased (-1.1%) to 98.856% when pulling 94f686cc8ed9670789dd47c265aa1bf6794bbd6b on screen_recording into 865459fc61b5d7090d09b2338021fdb7206a9969 on master.


Extra spaces in fediverse => Bluesky bio

This is a very minor, silly issue, but whenever a bio gets truncated it'll get ellipsized with  [...] . Note the extra space after the closing bracket.
There's another extra space in the bridging disclaimer: [bridged from URL on the fediverse by fed.brid.gy ]
When you're limited to 256 characters every lost character matters.
On a related note I'm not sure if it's necessary to specify it was bridged from the fediverse (or other services) when already providing an url. It's good advertisement for the original service, but it eats other 16 characters.

This one is sadly necessary. Without it, Bluesky's auto-linking logic includes the trailing ] and links to [https://fed.brid.gy/]](https://fed.brid.gy/]) , which doesn't work.

You could presumably use a zero-width space (U+200B) instead of a standard space character here. It wouldn't affect the character count, but would look slightly nicer.


too many SQL variables

This is the error I am seeing every 5-6 min in the log. What does it mean and should I be concerned? Needless to say I have not won in weeks and est is 3-4 days.
2021-09-15T03:52:53.184 full_node full_node_server        : ERROR    Exception: too many SQL variables <class 'sqlite3.OperationalError'>, closing connection {'host': '<IP_ADDRESS>', 'port': 9444}. Traceback (most recent call last):
File "spare\server\server.py", line 536, in api_call
File "asyncio\tasks.py", line 442, in wait_for
File "spare\server\server.py", line 533, in wrapped_coroutine
File "spare\server\server.py", line 526, in wrapped_coroutine
File "spare\full_node\full_node_api.py", line 244, in request_proof_of_weight
File "spare\full_node\weight_proof.py", line 77, in get_proof_of_weight
File "spare\full_node\weight_proof.py", line 119, in _create_proof_of_weight
File "spare\consensus\blockchain.py", line 695, in get_block_records_at
File "spare\full_node\block_store.py", line 181, in get_block_records_by_hash
File "aiosqlite\core.py", line 184, in execute
File "aiosqlite\core.py", line 129, in _execute
File "aiosqlite\core.py", line 102, in run
sqlite3.OperationalError: too many SQL variables

I have the same message "ERROR Exception: too many SQL variables" and the wallet is not synced as well.  It has been 5 days. I have no idea how to fix the issue : (

Finally fixed it.  Would still say this is a bug I see many people with the same problem.


Fix slow start time

Model validation is only needed when starting a worker, status, multi, etc. shouldn't need this, and full validation can be really slow, depending on the django project.

hi, could you fix the merge conflict?


Putting data from multiple topics into single Kafka topic

We are tying to integrate Kafka connector to write to Cassandra. We have multiple topics in which data is coming in, but only partial fields. e.g.
TopicA:
PK1 PK2 C1 C2
TopicB:
PK1 PK2 C3 C4
TopicC:
PK1 PK2 C5 C6
Cassandra Target Table:
PK1 PK2 C1 C2 C3 C4 C5 C6
We want to update all possible columns having same primary key within same row. Right now, it is overwriting the other columns with null values. Also, in our use case we cannot opt for windowing as data arrival sequence is unknown.
Please help.

hi,
we are also trying same kind of load to cassandra. do have any solution
thank you

@indrajagadeesh @mananstar2001 Have you looked at connect.cassandra.default.value in https://docs.lenses.io/connectors/sink/cassandra.html

Thank you for responding @andrewstevenson,
this my request body :
{
"name": "cassandra-sink-orders-16",
"config": {
"connector.class": "com.datamountaineer.streamreactor.connect.cassandra.sink.CassandraSinkConnector",
"connect.cassandra.key.space": "kconnect_sink",
"tasks.max": "1",
"connect.cassandra.username": "cassandra",
"connect.cassandra.password": "cassandra",
"connect.cassandra.contact.points": "localhost",
"connect.cassandra.port": "9042",
"value.converter": "io.confluent.connect.avro.AvroConverter",
"key.converter": "org.apache.kafka.connect.storage.StringConverter",
"connect.cassandra.default.value": "UNSET",
"connect.cassandra.export.route.query": "INSERT INTO part_table1 SELECT id, last_name AS name, value2 FROM topic2;INSERT INTO part_table1 SELECT id, name, value1 FROM topic1;",
"topics": "topic2,topic1",
"value.converter.schema.registry.url": "http://localhost:8083"
}
}
but, still i am face this issue

can please help me with proper rest call

@mananstar2001 what version of the connector are you using? You have connect.cassandra.export.route.query is very old.

Hi andrewstevenson,
i am using this version : kafka-connect-cassandra-0.2-3.0.0-all.jar
this my rest body :
{
"name": "cassandra-sink-orders-16",
"config": {
"connector.class": "com.datamountaineer.streamreactor.connect.cassandra.sink.CassandraSinkConnector",
"connect.cassandra.key.space": "kconnect_sink",
"tasks.max": "1",
"connect.cassandra.username": "cassandra",
"connect.cassandra.password": "cassandra",
"connect.cassandra.contact.points": "localhost",
"connect.cassandra.port": "9042",
"value.converter": "io.confluent.connect.avro.AvroConverter",
"key.converter": "org.apache.kafka.connect.storage.StringConverter",
"connect.cassandra.default.value": "UNSET",
"connect.cassandra.export.route.query": "INSERT INTO part_table1 SELECT *, last_name AS name FROM part2 ;INSERT INTO part_table1 SELECT * FROM part1;",
"topics": "part2, part1",
"value.converter.schema.registry.url": "http://localhost:8083"
}
}
can you please provide proper configuration if there is mistake.

@mananstar2001 that's very old and doesn't have this functionality. You should upgrade to the latest, 1.2.2

Thanks a lot @andrewstevenson, after upgrade it worked as desired.


Problems using JWT as authorization - ModuleNotFoundError: No module named 'requests'

Hey again :)
I try to fuzz some app where endpoints are secured with token. The token is valid for 60s.
I created some script, which retrieves a valid token and prints the header:
I tested this script before and after executing RestTestGen, this works.
import json
import requests

# Function to get the token from the login endpoint
def get_token():
    url = "http://localhost:3000/login"
    # Replace with your actual login credentials if required
    login_data = {
        "username": "john_doe",
        "password": "password1234"
    }
    response = requests.post(url, data=login_data)
    if response.status_code == 200 or response.status_code == 201:
        # Assuming the token is in the 'token' field of the JSON response
        return response.json().get("access_token")
    else:
        print(f"Failed to get token: {response.status_code} - {response.text}")
        return None

# Initialize the rtg_info dictionary
rtg_info = {
    "name": "Authorization",
    "value": "",
    "in": "header",
    "duration": 60
}

# Get the token from the login endpoint
token = get_token()
if token:
    # Update the rtg_info dictionary with the new token
    rtg_info["value"] = f"Bearer {token}"
    # Print the updated rtg_info dictionary as a JSON string
    print(json.dumps(rtg_info))
else:
    print("Could not retrieve the token.")

The script returns:
{"name": "Authorization", "value": "Bearer eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzdWIiOjEsInVzZXJuYW1lIjoiam9obl9kb2UiLCJpYXQiOjE3MTgwMjUyNDgsImV4cCI6MTcxODAzMTI0OH0.GKQs4DJ9YeUmquoTMXdN2DP3DhneoZPyUa6DLt2avns", "in": "header", "duration": 60}
When executing RestTestGen, I receive:
13:20:34.247 [main] ERROR io.resttestgen.boot.AuthenticationInfo -     import requests
13:20:34.247 [main] ERROR io.resttestgen.boot.AuthenticationInfo - ModuleNotFoundError: No module named 'requests'
13:20:34.248 [main] ERROR io.resttestgen.boot.cli.App - An error occurred while starting RestTestGen. Please report it on GitHub.

FIxed this by changing the Dockerfile to:

FROM gradle:7.6.2-jdk11-jammy
RUN apt-get update && apt-get install -y python3 python3-pip
WORKDIR /app
COPY requirements.txt /app/
RUN pip3 install --no-cache-dir -r requirements.txt
CMD gradle run


Updated aws-cpp-sdk-core's CMakeLists.txt

When I generate Visual Studio Solution (.sln) from cmake for SDK DLL, I'm in a spot of bother due to adding manually AWS_CUSTOM_MEMORY_MANAGEMENT into Visual Studio Project file.
So, how about adding AWS_CUSTOM_MEMORY_MANAGEMENT definition when USE_AWS_MEMORY_MANAGEMENT is ON?

Recent versions of the SDK should no longer need any definitions like this.  SDKConfig.h will get generated at configuration time and contain your memory management choice.

AWS_CUSTOM_MEMORY_MANAGEMENT does not be defined in SDKConfig.h when doing cmake from the master branch of this repo.

What's in your SDKConfig.h?

one line:
#define USE_AWS_MEMORY_MANAGEMENT
but, I can't find the relation between USE_AWS_MEMORY_MANAGEMENT and AWS_CUSTOM_MEMORY_MANAGEMENT.

Oops, every reference to AWS_CUSTOM_MEMORY_MANAGEMENT should be replaced by USE_AWS_MEMORY_MANAGEMENT.  We'll push a fix soon.

this has been pushed. Thanks for your contriubtion.


Improve the look of remote branch deletion

Currently it looks like deleting a remote branch is just like deleting a local branch, instead of pushing to the remote that the remote branch should just be null

Put this in the advanced push window


access info provided by provisionig but not visible in "my subscriptions"

I am providing an access info in my provisioning script with content "hello".
But the view in my subscrictiptions  shows the value which was defined in the technical service.
echo '{
"status": "ok",
"message": "Docker provisioned successfully.",
"data": {
"access info": "hello"
}
}'
echo "END_OF_SCRIPT"

To get this done, please use "accessInfo" field instead of "access info"

ok - this helped

This is already corrected in the documentation


Add CHROME_HEADLESS and clean up headless hacks

This is a follow-up of #48 that restores windowed mode support in dockerless execution


Stack enhancements

Is your feature request related to a problem? Please describe.
Environment variables modification for update stack
Support docker-compose down for stack
Describe the solution you'd like
Environment variables modification for update stack
Support docker-compose down for stack
Describe alternatives you've considered
None found
Additional context
None

Hi there,
After reviewing this I think this is 2 different feature requests.
I will close this and ask that you open a feature request for each topic.


Graph does not support Datazoom?

Version
4.7.0
Reproduction link
https://codepen.io/David_Guan/pen/WNQdqqr
Steps to reproduce
//中文描述
如果你将代码第66行的"scatter"更换为"graph"，页面将会一片空白
// English problem description
If you replace the scatterer in line 66 with graph, the page will be empty
What is expected?
// English problem description
I have nearly 10,000 elements to show their relationships, and I can't see anything if I just use the “graph” type. I want to control the display of the data by using the Datazoom.Or provide a way to show relationships clearly while keeping the volume of data
//中文描述
我有将近一万个元素要展示他们之间的关系，如果只用关系图将会什么也看不清，我想通过datazoom来控制数据的显示。或者在保持数据量的前提下提供一种清晰展示关系的方法
What is actually happening?
// English problem description
The page doesn't show anything
//中文描述
页面什么也不显示

dataZoom is not supposed to be used with graph. I think #12567 may have solved your request.

dataZoom is not supposed to be used with graph. I think #12567 may have solved your request.

Hello,I want to ask you set series.zoom and series.center,Are they new features that are not yet supported or do they already support no documentation.If it's just a lack of documentation, can you tell me how it should be used in my example

They are missing in the document. It's available here: https://github.com/apache/incubator-echarts-doc/commit/8d001e86a2190b9ebdc2f344a7820a563ed9299a

它们在文档中丢失。在此处可用：apache / incubator-echarts-doc @ 8d001e8

I'm sorry. Is that it
option={
...
series: [{
type: 'graph',
layout: 'force',
.......
zoom:[3.97,3.71],
......}]
}
If this is the case, the page will not display

Yes, but zoom should be a number rather than an array.

是的，但是zoom应该是数字而不是数组。

Excuse me, there are a lot of nodes on the page, what is the API to get the coordinate axis information of an element? I found this, but the new version seems to be gone。https://github.com/apache/incubator-echarts/issues/225

Yes, but zoom should be a number rather than an array.

Excuse me, there are a lot of nodes on the page, what is the API to get the coordinate axis information of an element? I found this, but the new version seems to be gone.
https://github.com/apache/incubator-echarts/issues/225

@2675569545 https://echarts.apache.org/zh/api.html#echartsInstance.convertToPixel

@2675569545 https://echarts.apache.org/zh/api.html#echartsInstance.convertToPixel

Thank you .Have a good day~


more efficient access to stream buffer

Scope & Purpose
Try to log messages without copying the stream buffer.
Internal change only.

[ ] :hankey: Bugfix
[ ] :pizza: New feature
[x] :fire: Performance improvement
[ ] :hammer: Refactoring/simplification

Checklist

[ ] Tests

[ ] Regression tests
[ ] C++ Unit tests
[ ] integration tests
[ ] resilience tests

[ ] :book: CHANGELOG entry made
[ ] :books: documentation written (release notes, API changes, ...)
[ ] Backports

[ ] Backport for 3.10: -
[ ] Backport for 3.9: -
[ ] Backport for 3.8: -

Related Information

[ ] Docs PR:
[ ] Enterprise PR:
[ ] GitHub issue / Jira ticket:
[ ] Design document:

Seems to be still disliked by clang's STL implementation. Need to shelve this until clang caught up.

Closed for now until clang's STL supports the functionality.


Bug: Log doesn't have full errors, instead it returns limited error information

What were you trying to achieve?
I'm trying to simulate on database rollback error for a service,
What are the expected results?
Logs with rollback error ( log with all nested  errors)
What are the received results?
Logs without rollback error ( log with top two layer errors)
Steps To Reproduce
Modified source code to throw rollback error in any service for create entity
In what environment did you encounter the issue?
Docker
Additional information you deem important
We should replace args = append(args, slog.Any("error", err)) with args = append(args, slog.String("error", err.Error()))
Because slog.Any("error", err) use JSON Marshal to stringify the error and We have custom JSON Marshal for Magistrala errors https://github.com/absmach/magistrala/blob/main/pkg/errors/errors.go#L59-L71, So in logs we could not get full error .
func (ce *customError) MarshalJSON() ([]byte, error) {
	var val string
	if e := ce.Err(); e != nil {
		val = e.Msg()
	}
	return json.Marshal(&struct {
		Err string `json:"error"`
		Msg string `json:"message"`
	}{
		Err: val,
		Msg: ce.Msg(),
	})
}

Magistrala Error() returns error string including message.
https://github.com/absmach/magistrala/blob/main/pkg/errors/errors.go#L41-L49
Is this correct ?


InvalidArgumentError: Cannot convert a Tensor of dtype resource to a NumPy array.

System information

Linux Ubuntu 16.04
TensorFlow 2.2
Python 3

Describe the current behavior

user_input = Input( shape=(None, 1), dtype=tf.int32 )
# same error with: user_input = Input( shape=(1,), dtype=tf.int32 )

MF_Embedding_User = tf.Variable(tf.random.normal([8176, 20], stddev=0.05), dtype=tf.float32, name='user_embedding')

user_embedding = tf.nn.embedding_lookup(MF_Embedding_User, user_input)
#same error with: tf.gather

user_input = [0,1,2,3,4,5]
model = Model( user_input, user_embedding )

Describe the expected behavior
I would like to define an Input vector of indices that I can use whether in a tf.ebedding_lookup or a tf.gather
It used to work in TF1 with placeholders and not anymore.
I don't know how i can Input my index vectors in my model
I know it is possible to define a @tf.function but idk how to do this and still be abble to train my model
I am really stuck.
Thank you for your help :)

@MaxHeuillet
Please, refer similar issue #37441 and see if it helps you.
If the issue still persists, request you to share colab link or simple standalone code with supporting files to reproduce the issue in our environment. It helps us in localizing the issue faster.Thanks!


How to model historical data in some sort of changelog-like form?

First of all, thank you for the library; it's hugely impressive to me and I love the paradigm of a statically compiled ORM.
I'm interested in trying to use ent for a data model that semi-closely follows the anchor modeling technique.
For the purposes of the thought exercise, let's assume I have two entities, AThing and Label, with have a M2M relationship between the two. Labels are considered immutable, to 'modify' a label on a particular AThing would actually be removing the relationship and creating a new label, then adding that new label to AThing
The application is a metadata store with untrusted data. I'd like to track any changes (additions/removes of Label edges) to AThing to have some sort of audit/approval/revert flow in the application.
My initial thoughts were something along the lines of, I'm curious what your thoughts are or if there's a better way to do it that I missed?
Option 1

Maintain two schema defintions, AThing and AThingHistory, which would be somewhat annoying to keep them in sync.
Potentially model AThing as a mixin that AThing includes with no other definitions and AThingHistory includes with any other needed fields for tracking history to solve the 'keeping schemas in sync' problem.
Use hooks to ensure that anything written to AThing is updated to AThingHistory and corresponding references updated.

Option 2

Model it without any AThingHistory entity, use a surrogate key, don't use the autogenerated graphql/gRPC APIs and implement my own that ensure queries for AThing history are always queried using the surrogate key and ORDER BY date LIMIT 1.
I haven't dug too much into this one, but I suspect this would cause a lot of problems with the query planner?

Option 3

Completely ditch modeling history in ent and just write some sort of diff DTO that gets appended to a single history table with the enum indicating the entity type and the PK as a foreign key. Solve rollbacks/changelog generation completely in application code by reading out those diffs.

How about add a hook, record every mutation ?

hi @v3n,
as @wenerme mentioned, ent has extensive support for hooks in many layers of the framework.  many users use hooks to express complex logic on entity mutations, enforce privacy (authorization) policies and as middleware (loggers, auditors, metrics, tracing, ... ). You can read more about it here:
https://entgo.io/docs/hooks

Hi,
I'm not sure if this should be a different issue, but this title and context fit our question quite well. Feel free to move this to another issue if necessary.
We've tried implementing a history table that would record every change via Ent's hooks system. Our setup is :

A history table, that will record, for each column modified :

the ID of the row being modified/created/deleted
the column's name
the value before modification, if applicable
the value after modification, if applicable
an OperationID : a unique identifier, to separate a specific operation's modifications from another. If a user modifies 2 columns on a row, history will record 2 modifications with the same OperationID.

A global hook when the postgreSQL client is initialized. The hook is defined as :

func LogRecord(next ent.Mutator) ent.Mutator {
    return ent.MutateFunc(func(ctx context.Context, m ent.Mutation) (ent.Value, error) {
        // Before mutation code block
        defer func() {
            // After mutation code block
        }()

        return next.Mutate(ctx, m)
    })
}

With this setup, we're having some issues with the ent.Mutation API capabilities :

The ID column doesn't seem to be given in a Create operation, in the deferred block. Plus, it seems we have to type assert to specific mutation types to get the ID of the modified row, but we would like to avoid this kind of switch/case pattern. The hook was made global specifically so that we wouldn't have to change this code.
Our way of getting the ID looks like this :

if !m.Op().Is(ent.OpCreate) {
	// Type assert to specific mutation
	storeMut, ok := m.(*ent.StoreMutation)
	if ok {
		recordID, _ = storeMut.ID()
	}
}

Of course, this is not even working, since it doesn't handle the Create operation. So 2 questions :

Is there a way to avoid a huge switch/case type assertion?
Is there a way to get the created ID with no concurrency issues?

There is no unique identifier associated to the operation being ran. If an Update operation modifies 2 columns, the hook will get called twice, and there is no way inside the hook to know that those 2 calls are, in fact, from the same action. Question : Is there a good way to track this?

Thank you for the help.
Nathanael

Hey @Guiren,

Is there a way to avoid a huge switch/case type assertion?

There are 2 options how to do this:

Type-assert on a custom interface as follows:

if idr, ok := m.(interface { ID() (int, bool) }); ok {
	id, exists := idr.ID()
	if exists {
		 // id is valid and exists in mutation.
	}
}

Use the dynamic API to get the ID field by its name:

id, exists := m.Field("id")
if exists {
	 // id is valid and exists in mutation, but needs type-cast.
}

Is there a way to get the created ID with no concurrency issues?

The created-id can be retrieved after the mutation was executed (do you need an example for this?). Please elaborate on what do you mean by "no concurrency issues".

There is no unique identifier associated to the operation being ran. If an Update operation modifies 2 columns, the hook will get called twice, and there is no way inside the hook to know that those 2 calls are, in fact, from the same action. Question : Is there a good way to track this?

I'm not sure I follow. Hooks are executed only when Save or Exec are called (For example, client.T.Update().SetF1(..).SetF2(..).SaveX(ctx) will execute the hook only 1 time.).
You can feel free to continue the discussion on this thread or ping me on our Slack chanhel.

Hi! Thanks for the quick response. I'd like to point out my ent go.mod version number, just in case : v0.8.1-0.20210510173245-f7db15ccbb5b.
Second, here's a sample of how we create and update models (here, the Template model) via ent :
	dbTmpl, err := postgres.PGClient.Template.Create(). // Update() is used on update instead
		SetName(tmpl.Name).
		SetTextColor(tmpl.TextColor).
		SetStickerColor(tmpl.StickerColor).
		SetWebsiteURL(tmpl.WebsiteURL).
		SetNillablePrimaryText(tmpl.PrimaryText).
		SetNillableHeadline(tmpl.Headline).
		SetNillableDescription(tmpl.Description).
		SetNillableImageID(tmpl.ImageID).
		SetRetailerID(tmpl.RetailerID).
		Save(context.Background())

as well as our hook declaration :
	PGClient.Use(
		hook.On(
			history.LogRecord,
			ent.OpDeleteOne|ent.OpCreate|ent.OpUpdate|ent.OpUpdateOne|ent.OpDelete),
	)

For your questions/remarks :

if idr, ok := m.(interface { ID() (int, bool) }); ok {
	id, exists := idr.ID()
	if exists {
		 // id is valid and exists in mutation.
	}
}

I actually didn't know you could assert like this, very cool! See just below for my results.

Is there a way to get the created ID with no concurrency issues?

The created-id can be retrieved after the mutation was executed (do you need an example for this?). Please elaborate on what do you mean by "no concurrency issues".

Forget the concurrency issues part, it's not relevant from what you said should be possible.
I just tried getting the ID again (on both Create and Update operations), but I'm getting nothing. The code snippet :
defer func() {	// After mutation code block
	// Getting the ID of the row :
	if idr, ok := m.(interface{ ID() (int64, bool) }); ok {
		id, exists := idr.ID()
		fmt.Printf("Row ID via Interface Assertion : %v (%v)\n", id, exists)
	}

	// Getting the ID through regular assertion :
	if idr, ok := m.(*ent.TemplateMutation); ok {
		id, exists := idr.ID()
		fmt.Printf("Row ID via Mutation Assertion : %v (%v)\n", id, exists)
	}
}()

For those logs, I'm getting for both Create and Update the following now :
Row ID via Interface Assertion : 0 (false)
Row ID via Mutation Assertion : 0 (false)

For context, I was in holiday last week. Before holidays, I managed to get an ID on update somehow, but today it's gone. No one else modified this branch in the meantime. I can't seem to reproduce getting the ID again ; if you have a simple example, I can try!

There is no unique identifier associated to the operation being ran. If an Update operation modifies 2 columns, the hook will get called twice, and there is no way inside the hook to know that those 2 calls are, in fact, from the same action. Question : Is there a good way to track this?

I'm not sure I follow. Hooks are executed only when Save or Exec are called (For example, client.T.Update().SetF1(..).SetF2(..).SaveX(ctx) will execute the hook only 1 time.).

Okay, this was my bad actually (I was logging inside the loop on all modified m.Fields()). By "operationID" I was referring to some kind of unique ID that would refer to this hook, problem gone now.

I'm actually also getting another issue on updates (operation is Update, not UpdateOne). Consider this code (before the deferred function/before the migration happens) :
// Before mutation, retrieve the value currently in the mutated columns
oldValues := make(map[string]interface{}, len(m.Fields()))
for _, field := range m.Fields() {
	oldValue, err := m.OldField(ctx, field)
	if err != nil {
		fmt.Println(err) // Old<field> is only allowed on UpdateOne operations
		continue
	}
	oldValues[field] = oldValue
}

Is it possible to get old values on an Update operation?
What are the UpdateOne and DeleteOne operations exactly?

Hey @Guiren,

What are the UpdateOne and DeleteOne operations exactly?

UpdateOne and DeleteOne mean that you update or delete one entity (by its ID). For example, client.T.UpdateOne(u),  t.Update() or client.T.DeleteOneID(id). Thus, it's not possible to get the ID or the OldValue in an operation that (can) mutate multiple entities.
Regarding your code:

	PGClient.Use(
		hook.On(
			history.LogRecord,
			ent.OpDeleteOne|ent.OpCreate|ent.OpUpdate|ent.OpUpdateOne|ent.OpDelete),
	)

The hook.On filters used to limit hooks to specific operations, but this hook is executed on all operations, and can be written as follows:
PGClient.Use(history.LogRecord)

For those logs, I'm getting for both Create and Update the following now :

Update to latest master using go get entgo.io/ent@master, rerun codegen, and the code should work for create operations.
Please let me know if you need more help here.

Hey!
Thanks again, UpdateOne is working now, but Create still doesn't. I got the latest ent version just in case, re-generated, and made the mutation very simple (only printing the ID after mutation), I'm guessing the PostgreSQL query is correct as well. Here's my code / logs :

Code

// Create query
	created, err := postgres.PGClient.Store.Create().
		SetRetailerID(shop.RetailerID).
		SetNillableExternalID(shop.ExternalID).
		SetName(shop.Name).
		SetLat(shop.Lat).
		SetLong(shop.Long).
		SetAddress(shop.Address).
		SetZip(shop.ZIP).
		SetCityName(shop.CityName).
		SetRadius(shop.Radius).
		SetMissingData(shop.MissingData).
		Save(context.Background())

// Hook code, removed everything not essential to test getting the ID
func LogRecord(next ent.Mutator) ent.Mutator {
	return ent.MutateFunc(func(ctx context.Context, m ent.Mutation) (ent.Value, error) {
		defer func() {
			if idr, ok := m.(interface{ ID() (int64, bool) }); ok {
				id, exists := idr.ID()
				fmt.Printf("HOOK -> Row ID : %v (%v)\n", id, exists)
			}
		}()

		return next.Mutate(ctx, m)
	})
}

Log :

2021-06-01T11:19:56.932097729+02:00 dbg Tx(71eb581e-3a68-4af9-b251-0757e75cec48).Query: query=INSERT INTO "stores" ("external_id", "name", "lat", "long", "address", "zip", "city_name", "radius", "missing_data", "retailer_id") VALUES ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10) RETURNING "id" args=[...]
2021-06-01T11:19:56.932770913+02:00 dbg Tx(71eb581e-3a68-4af9-b251-0757e75cec48): committed

HOOK -> Row ID : 0 (false)

Any idea of what can go wrong? :(

Can you please paste here the ent version you use? Thanks

The go.mod version now shows : entgo.io/ent v0.8.1-0.20210531191931-fdc5f2b7e9e0

There’s an example in our integration tests, please try to use it as a reference:
https://github.com/ent/ent/blob/11567a3926bb8c847523d3d17115cc56fcab9d7a/entc/integration/hooks/hooks_test.go#L168
If you still have troubles with it, please ping me in our Slack channel or share with me a temporary repository to reproduce this. Thanks


Installation error on Windows

Component
Other (please describe)
Have you ensured that all of these are up to date?

[X] Foundry
[X] Foundryup

What version of Foundry are you on?
No response
What command(s) is the bug in?
cargo install --git https://github.com/foundry-rs/foundry foundry-cli anvil --bins --locked
Operating System
Windows
Describe the bug
The first time I've tried to install Foundry some months ago on Windows 10, I've faced the following error message:
failed to run custom build command for ring v0.16.20
This message appeared during the installation process after running the Windows installation command which is shown in the Foundry Book:
cargo install --git https://github.com/foundry-rs/foundry foundry-cli anvil --bins --locked

When I first saw this bug, I decided to go to the Foundry Support telegram group and ask how it could be fixed. By that time, @onbjerg helped me and these were the recommendations that he said that I should try in order to be able to install Foundry (the methods are presented in the real sequence).

Make sure to have Rust installed

Make sure to have Msvc build tools installed: https://docs.microsoft.com/en-us/windows/dev-environment/rust/setup#install-visual-studio-recommended-or-the-microsoft-c-build-tools

Try the following command:  rustup set default-host x86_64-pc-windows-msvc

Before going to the fourth recommendation, which actually was the one that solved my problem when I had it, Oliver asked for my rustup show, which returned:
Default host: x86_64-pc-windows-msvc
rustup home:  C:\Users\andrey\.rustup

installed toolchains
--------------------

stable-x86_64-pc-windows-gnu (default)
stable-x86_64-pc-windows-msvc

active toolchain
----------------

stable-x86_64-pc-windows-gnu (default)
rustc 1.59.0 (9d1b2106e 2022-02-23)

Try the following command: rustup default stable-x86_64-pc-windows-msvc

This fourth step solved the problem! After typing the above line, I wrote the cargo install command again and everything worked fine.
I don't exactly know how much every step is correlated to one another, that's why I'm providing the full explanation instead of just sending the fourth step in this issue :)
I decided to open this issue because yesterday another person had the same issued I had had in the past and he asked for a solution in our telegram group. I don't know exactly what causes this error, but as there are still many Windows users out there, I think this bug should be fixed, so it doesn't scare away newcomers who run Windows.
You can see the complete error message in this picture which was recently posted by other person who had the same issue (Evergreen) on the Foundry Support telegram group:

I think the issue is that some people might be using the GNU toolchain without having those tools installed, so the general advice/requirements would be:

Install Rust using rustup
Make sure to have MSVC build tools installed (Rust needs this)
Install the MSVC toolchain: rustup default x86_64-pc-windows-msvc

More generally though, we should get Windows builds working again so no one has to compile from source if they don't want to


Fix stylish formatter for node 6 or prior

Bable doesn't transpile String.padStart and String.padEnd. We need to use a polyfill to make those functions work in node 6 or older (Node supports those functions starting with version 7).

Pull Request Test Coverage Report for Build 505

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 97.497%

Totals

Change from base Build 502:
0.0%

Covered Lines:
634

Relevant Lines:
643

💛  - Coveralls


Hosted wallet

It would be good to have a simple hosted wallet app that uses the desktop wallet ui along with the rest api client to allow users to create and manage hosted wallets for incentives and other testing purposes.
This will also make it easier to run incentives on console v2, explorer or other apps

Closing as already implemented.
To manage a hosted wallet use the following URL:
https://vega-hosted-wallet.on.fleek.co/


Arithmetic operation resulted in an overflow.

Why when doing anywork in Blockchain.Committing or Blockchain.Committed Crashes? I made my own custom plugin
System log folder: "akka---NeoSystem-user-$a"
Contents:
[Error][03:59:41.572] Arithmetic operation resulted in an overflow.
[Error][03:59:52.244] Arithmetic operation resulted in an overflow.
[Error][03:59:52.253] Arithmetic operation resulted in an overflow.
[Error][03:59:52.259] Arithmetic operation resulted in an overflow.
[Error][03:59:52.262] Arithmetic operation resulted in an overflow.
[Error][03:59:52.266] Arithmetic operation resulted in an overflow.
[Error][03:59:52.271] Arithmetic operation resulted in an overflow.
[Error][03:59:52.280] Arithmetic operation resulted in an overflow.
[Error][04:02:01.757] Arithmetic operation resulted in an overflow.
[Error][04:02:12.410] Arithmetic operation resulted in an overflow.
[Error][04:02:12.421] Arithmetic operation resulted in an overflow.
[Error][04:02:12.431] Arithmetic operation resulted in an overflow.
[Error][04:02:12.433] Arithmetic operation resulted in an overflow.
[Error][04:02:12.444] Arithmetic operation resulted in an overflow.
[Error][04:29:36.251] Arithmetic operation resulted in an overflow.
[Error][04:29:36.263] Arithmetic operation resulted in an overflow.
[Error][04:29:36.276] Arithmetic operation resulted in an overflow.
[Error][04:29:36.279] Arithmetic operation resulted in an overflow.
[Error][04:29:36.280] Arithmetic operation resulted in an overflow.
[Error][04:29:36.282] Arithmetic operation resulted in an overflow.
[Error][04:29:36.285] Arithmetic operation resulted in an overflow.
[Error][04:29:36.287] Arithmetic operation resulted in an overflow.
[Error][04:29:36.288] Arithmetic operation resulted in an overflow.
[Error][04:29:48.744] Arithmetic operation resulted in an overflow.

In order to stop this from happening i have to wrap any of my code in
            _ = Task.Run(() =>
            {
                // code here doesnt crash
            });

My Plugin Code
using Google.Cloud.Firestore;
using Neo;
using Neo.Events.Models.FireStore.Converters;
using Neo.Ledger;
using Neo.Network.P2P.Payloads;
using Neo.Persistence;
using Neo.Plugins;
using NeoEvents.FireStore.Extensions;

namespace NeoEvents.FireStore
{
    public class FireStorePlugin : Plugin
    {
        public override string Name => "Neo Event FireStore";
        public override string Description => "Push blockchain information to firestore.";

        private FirestoreDb _fireDb;
        private WriteBatch _fireBatch;

        #region New & Overrides

        public FireStorePlugin()
        {
            Blockchain.Committing += OnBlockchainCommitting;
            Blockchain.Committed += OnBlockchainCommitted;
        }

        public override void Dispose()
        {
            GC.SuppressFinalize(this);
            Blockchain.Committing -= OnBlockchainCommitting;
            Blockchain.Committed -= OnBlockchainCommitted;
        }

        protected override void Configure()
        {
            PluginSettings.Load(GetConfiguration());
        }

        protected override void OnSystemLoaded(NeoSystem system)
        {
            if (system.Settings.Network != PluginSettings.Default.Network) return;

            _fireDb = new FirestoreDbBuilder()
            {
                ProjectId = "neo-events-99",
                EmulatorDetection = Google.Api.Gax.EmulatorDetection.EmulatorOnly,
                ConverterRegistry = new ConverterRegistry()
                {
                    new UInt160Converter(),
                    new UInt256Converter(),
                    new ReadOnlyMemoryByteConverter(),
                }
            }.Build();

            _fireBatch = _fireDb.StartBatch();
        }

        #endregion

        private void OnBlockchainCommitting(NeoSystem system, Block block, DataCache snapshot, IReadOnlyList<Blockchain.ApplicationExecuted> applicationExecutedList)
        {
            if (system.Settings.Network != PluginSettings.Default.Network) return;

            _ = Task.Run(() =>
            {
                var model = block.ToModel();
                var docRef = _fireDb
                    .Collection(PluginSettings.Default.Network.ToString())
                    .Document(string.Format("block_{0}", block.Index));

                _fireBatch.Create(docRef, model);
            });
        }

        private void OnBlockchainCommitted(NeoSystem system, Block block)
        {
            if (system.Settings.Network != PluginSettings.Default.Network) return;

            _ = Task.Run(async () => await _fireBatch.CommitAsync().ConfigureAwait(false));
        }
    }
}

This is related to neo.dll not the neo-cli.


Internal plugin architecture

Add internal plugin architecture similar to that of the Geometry theme. This will give better control over performance and integration with the main theme.

Created project for this goal.


Make UnionToIntersection respect inner unions

A | (B | C) | D previously evaluated to (A & B & C & D), but we want to maintain the (B | C) union. Now, it evaluates to A & (B | C) & D, or (A & B & D) | (A & C & D) when distributed
You can read my full explanation (and old version of the solution) here
(This version is more efficient than my original solution at the above link)

Pull Request Test Coverage Report for Build 251703895

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 224245873:
0.0%

Covered Lines:
337

Relevant Lines:
337

💛  - Coveralls


Problem with STARTTLS auth

What operating system are you using?
Ubuntu 16.04 LTS
What version of N1 are you using?
0.4.56-816edde
Bug?
Do you have any third-party plugins installed? If so, which ones?
No.
Is the issue related to a specific email provider (Gmail, Exchange, etc.)?
Yes, smtp/imap of my university use STARTTLS for authentification
Connect screen (see screenshoot) return this :
IMAP Error when connecting to 'imap.univ-rouen.fr': 'Lookup failed yh8mb58702214pab'. Please check your IMAP settings.
Feature Request?
Does this feature exist in another mail client or tool you use?
It works with Thunderbird with exact same settings + STARTTLS activated (triple checked) :(

Hi—thanks for reaching out. This definitely sounds like a bug, but we haven't seen many reports of this. Can you try changing your IMAP and SMTP ports to these below? It's possible that Thunderbird was changing them for you automatically to the ones typically used with STARTTLS:
IMAP: Port 993
SMTP: Port 465

Hi, i have the same error with information you give me.
IMAP Error when connecting to 'imap.univ-rouen.fr':
'Lookup failed rr13mb62174346pab'. Please check your IMAP settings.
I try to find some errors in log, without success.
On oct. 17 2016, at 7:21 pm, Ben Gotow<EMAIL_ADDRESS>wrote:

Hi—thanks for reaching out. This definitely sounds like a bug, but we
haven't seen many reports of this. Can you try changing your IMAP and SMTP
ports to these below? It's possible that Thunderbird was changing them for you
automatically to the ones typically used with STARTTLS:

IMAP: Port 993

SMTP: Port 465

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on
GitHub, or
[mute the thread](https://github.com/notifications/unsubscribe-auth/AAcdmciJ65
eBfL3iOMOfKQmjNJKFyL42ks5q066pgaJpZM4KYsG9).![](https://github.com/notificatio
ns/beacon/AAcdmZAQiWLxhYJl6VOWkQSqTV0IHhenks5q066pgaJpZM4KYsG9.gif)

Any news on this problem @bengotow ? I can't send my pro mail with nylas actually :/
I try with the last release, without success.

It works now.AirportsSpider


feat!: rework how i.py handles the event loop

About
This pull request reworks how interactions.py handles the event loop to follow by the standards set by asyncio.run() - basically, instead of making and holding the event loop, it should instead let asyncio.run() make it, and get it with asyncio.get_running_loop().
An attempt has been made to keep breaking changes minimal, but there are two exceptions:

Running any method in Client before running await client.astart() or client.start() that relies on _websocket will not work, erroring out instead. That shouldn't be a huge problem, as await client.wait_until_ready() will work regardless.
If an extension is loaded before the bot is started and relies on the event loop (IE creating a task to run an asynchronous function), it will most likely error out (unless bot.load is run in an asynchronous function). To avoid this, users are suggested to do the following:

async def main():
    bot.load("ext_that_uses_loop")
    await bot.astart()

asyncio.run(main())

Draft Notice
Nothing about this is final, and feedback is important. I've only done basic testing, so more needs to be done to find any bugs, and the solution to client.wait_until_ready() needs to be looked at too. Really, this PR was just to get the ball rolling.
Checklist

[x] The pre-commit code linter has been run over all edited files to ensure the code is linted.
[x] I've ensured the change(s) work on 3.8.6 and higher.

I've made this pull request: (check all that apply)

[x] For the documentation
[x] To add a new feature
[x] As a general enhancement
[x] As a refactor of the library/the library's code
[ ] To fix an existing bug
[ ] To resolve #ISSUENUMBER

This is:

[x] A breaking change

Closing this due to lack of activity. I'll open it again if we decide to re-approach this topic.


Add KhayeBeth's personal page

Description
This PR is to add my personal page
Additional Information

[x] I have read the contributing docs (if this is your first contribution)
[x] This is not a duplicate of any existing pull request

Related Issues
Your ENS/address: 0x84fF709680E9378734Bae1D3B55C6568d21671c3

Mr. @carletex  Please help me review this PR

Hey thanks @Okhayeeli !
It seem the github action is failing because the code is not formatted properly

Example :

It seems that your text editor or IDE is not configured to use prettier formatting on save, could you please configure it ? This will also help in other futures projects you work on.
If you are using VsCode checkout this article, or you could also search on google / youtube
:  "How to configure prettier formatting on save in ${your text editor name}"
Also to get the warnings in text editor itself you may install vscode eslint extension
Please let use know if you need any help !

Thanks @Okhayeeli !!


Docs fail to build with sphinx 2.4

Description
As reported by Andreas Beckmann in Debian Bug #959775:

pycsw started to FTBFS when sphinx 2.4 reached sid:
[...]
PYTHONPATH=. http_proxy='<IP_ADDRESS>:9' sphinx-build -N -bhtml docs/ build/html # HTML generator
Running Sphinx v2.4.3
making output directory... done
building [mo]: targets for 0 po files that are out of date
building [html]: targets for 31 source files that are out of date
updating environment: [new config] 31 added, 0 changed, 0 removed
reading sources... [  3%] administration
reading sources... [  6%] api
reading sources... [  9%] ckan
reading sources... [ 12%] committers
reading sources... [ 16%] configuration
reading sources... [ 19%] contributing
reading sources... [ 22%] csw-support
reading sources... [ 25%] distributedsearching
reading sources... [ 29%] docker
reading sources... [ 32%] geonode
reading sources... [ 35%] hhypermap
reading sources... [ 38%] index
reading sources... [ 41%] installation
reading sources... [ 45%] introduction
reading sources... [ 48%] json
reading sources... [ 51%] license
reading sources... [ 54%] migration-guide
reading sources... [ 58%] oaipmh
reading sources... [ 61%] odc
reading sources... [ 64%] opensearch
reading sources... [ 67%] outputschemas
reading sources... [ 70%] profiles
reading sources... [ 74%] repofilters
reading sources... [ 77%] repositories
reading sources... [ 80%] sitemaps
reading sources... [ 83%] soap
reading sources... [ 87%] sru
reading sources... [ 90%] support
reading sources... [ 93%] testing
reading sources... [ 96%] tools
reading sources... [100%] transactions

looking for now-outdated files... none found
pickling environment... done
checking consistency... done
preparing documents... done
writing output... [  3%] administration

Theme error:
An error happened in rendering the page administration.
Reason: TemplateNotFound('i')

pycsw_2.4.2+dfsg-2.log.gz

Environment

operating system: Debian GNU/Linux
Python version: 3.8.3~rc1
pycsw version: 2.4.2
source/distribution

[x] DebianGIS/UbuntuGIS

Steps to Reproduce
Build docs with python3-sphinx from Debian unstable.
Additional Information
Traceback:
# PYTHONPATH=. http_proxy='<IP_ADDRESS>:9' sphinx-build -v -T -N -bhtml docs/ build/html # HTML generator
Running Sphinx v2.4.3
building [mo]: targets for 0 po files that are out of date
building [html]: targets for 31 source files that are out of date
updating environment: [new config] 31 added, 0 changed, 0 removed
reading sources... [  3%] administration
reading sources... [  6%] api
reading sources... [  9%] ckan
reading sources... [ 12%] committers
reading sources... [ 16%] configuration
reading sources... [ 19%] contributing
reading sources... [ 22%] csw-support
reading sources... [ 25%] distributedsearching
reading sources... [ 29%] docker
reading sources... [ 32%] geonode
reading sources... [ 35%] hhypermap
reading sources... [ 38%] index
reading sources... [ 41%] installation
reading sources... [ 45%] introduction
reading sources... [ 48%] json
reading sources... [ 51%] license
reading sources... [ 54%] migration-guide
reading sources... [ 58%] oaipmh
reading sources... [ 61%] odc
reading sources... [ 64%] opensearch
reading sources... [ 67%] outputschemas
reading sources... [ 70%] profiles
reading sources... [ 74%] repofilters
reading sources... [ 77%] repositories
reading sources... [ 80%] sitemaps
reading sources... [ 83%] soap
reading sources... [ 87%] sru
reading sources... [ 90%] support
reading sources... [ 93%] testing
reading sources... [ 96%] tools
reading sources... [100%] transactions

looking for now-outdated files... none found
pickling environment... done
checking consistency... done
preparing documents... done
writing output... [  3%] administration

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/sphinx/builders/html.py", line 1023, in handle_page
    output = self.templates.render(templatename, ctx)
  File "/usr/lib/python3/dist-packages/sphinx/jinja2glue.py", line 192, in render
    return self.environment.get_template(template).render(context)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1090, in render
    self.environment.handle_exception()
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 832, in handle_exception
    reraise(*rewrite_traceback_stack(source=source))
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 28, in reraise
    raise value.with_traceback(tb)
  File "/usr/share/sphinx/themes/basic/page.html", line 9, in top-level template code
    #}
  File "/build/pycsw-2.4.2+dfsg/docs/_templates/layout.html", line 1, in top-level template code
    {% extends "!layout.html" %}
  File "/usr/share/sphinx/themes/classic/layout.html", line 9, in top-level template code
    #}
  File "/usr/share/sphinx/themes/classic/../basic/layout.html", line 56, in top-level template code

  File "/usr/share/sphinx/themes/classic/../basic/layout.html", line 65, in block "content"
    {%- endfor %}
  File "/usr/share/sphinx/themes/classic/../basic/layout.html", line 65, in block "sidebar2"
    {%- endfor %}
  File "/usr/lib/python3/dist-packages/jinja2/sandbox.py", line 465, in call
    return __context.call(__obj, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/jinja2/runtime.py", line 679, in _invoke
    rv = self._func(*arguments)
  File "/usr/share/sphinx/themes/classic/../basic/layout.html", line 29, in template
    {%- macro relbar() %}
  File "/usr/lib/python3/dist-packages/sphinx/jinja2glue.py", line 213, in get_source
    raise TemplateNotFound(template)
jinja2.exceptions.TemplateNotFound: i

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/sphinx/cmd/build.py", line 276, in build_main
    app.build(args.force_all, filenames)
  File "/usr/lib/python3/dist-packages/sphinx/application.py", line 343, in build
    self.builder.build_update()
  File "/usr/lib/python3/dist-packages/sphinx/builders/__init__.py", line 297, in build_update
    self.build(to_build,
  File "/usr/lib/python3/dist-packages/sphinx/builders/__init__.py", line 361, in build
    self.write(docnames, list(updated_docnames), method)
  File "/usr/lib/python3/dist-packages/sphinx/builders/__init__.py", line 535, in write
    self._write_serial(sorted(docnames))
  File "/usr/lib/python3/dist-packages/sphinx/builders/__init__.py", line 545, in _write_serial
    self.write_doc(docname, doctree)
  File "/usr/lib/python3/dist-packages/sphinx/builders/html.py", line 618, in write_doc
    self.handle_page(docname, ctx, event_arg=doctree)
  File "/usr/lib/python3/dist-packages/sphinx/builders/html.py", line 1030, in handle_page
    raise ThemeError(__("An error happened in rendering the page %s.\nReason: %r") %
sphinx.errors.ThemeError: An error happened in rendering the page administration.
Reason: TemplateNotFound('i')

Theme error:
An error happened in rendering the page administration.
Reason: TemplateNotFound('i')

Thanks @sebastic .  Fixed in master and 2.4 branch.


Test fixes (node 12 and workflows reorganization)

What is the purpose of this pull request?

[x] Documentation update
[x] Bug fix
[x] New feature
[x] Other, please explain: Reworks CI test workflows

What changes did you make? (provide an overview)

Adds c8 ignore directives to node-version-specific code (2d7158d610d1f896250e5b6a6c39492ac8e07595) and fixes the directive at the end of the Headers constructor (f5f58fb3890494fa2f531ba8d9191eeb7ad8880b)
Fixes the test-artifact script so it will run on Windows (b914a9b26fdb813a4a0f1d0c973d0f5ca69897c6)
Changes the prepublishOnly script to test:cjs-build and adds it to the main ci workflow so it is tested on all environments (6d5769007a29846a59a5bb50d9e20fdcdc13ce2c)
Fixes a problem with using port 5000 in tests on shared CI environments, i.e. GitHub Actions (d4490ec0059594d00b0c7ff4b6dc520f9b27108e).  You can see where I hit this in GitHub action run<PHONE_NUMBER>.
Fixes a bug with the Node 12.0-12.9 version comparison for the aborted connection fix (#1038, 122614be9086697904864ee8e2f98f91e7b61325)
Fixes test running on Node 12 and reorganizes the GitHub workflows to test necessary environments. (878498da5002d4dd4d0d37755700150506efd5e2 and daed7f43b2d0ded6db4b82e6355481b17ca3bd60)

Which issue (if any) does this pull request address?

#1038 - Question about comparing Node version bug (fixed in 122614be9086697904864ee8e2f98f91e7b61325)

Is there anything you'd like reviewers to know?
This all started when I was trying to get the tests to run on Node 12.14 because that is the 12.x version that runs on AWS Lambda.  While working on this, I wanted to ensure test coverage was returned to 100% so I knew I had no missing pieces.  In that process, I encountered several issues, some of which are fixed separately (#1018, #1019, #1020, and #1022).  The main issue that this PR addresses is around the conversion to ECMAScript modules.  You will note the number of Node.js versions in the workflow strategy has increased.  Here is why:

10.17.0: lowest allowed version (package.json)
12.3.0: lowest allowed 12.x version (package.json)
12.16.3: esm package doesn't work properly with node 12.16, --experimental-modules is required
12.x (latest): --experimental-modules is on by default starting in 12.17.0 (see Node.js Blog: Node v12.17.0 (LTS), "ECMAScript Modules - --experimental-modules flag removal", 2020 May 26)
14.x: Active LTS

Also, it is worth noting that combining #1017, #1018, #1019, #1020, #1022, and this pull request results in 100% coverage:

Coveralls report: tekwiz:multiple/20201213
GitHub action result: typescript
GitHub action result: lint
GitHub action result: test

Last, but certainly not least -- maintainers should read daed7f43b2d0ded6db4b82e6355481b17ca3bd60 for how running tests changes with this.

@tinovyatkin I've made the change to the CI.yml to pull the minimum node-version from package.json

@Richienb Are there any other changes you would like to see on this?

Superseded; closing.


Docs/5646 rotate GitHub ci user pat

A reference to the issue / Description of it
https://github.com/ministryofjustice/modernisation-platform/issues/5646
How does this PR fix the problem?
I've rotated the secret and have added some documentation on the process for it in case that would be of use in future. The GitHub Resources workflow step in particular was a part where I wasn't aware that needed to happen.
How has this been tested?
Please describe the tests that you ran and provide instructions to reproduce.
I have run the GitHub resources job to import the new secrets from AWS Secrets Manager and subsequent workflows have successfully used the new secret. The status in Github shows that the new secret has been "Used within the last week".
Deployment Plan / Instructions
Will this deployment impact the platform and / or services on it?
Not if done correctly!
Checklist (check x in [ ] of list items)

[x] I have performed a self-review of my own code
[ ] All checks have passed
[x] I have made corresponding changes to the documentation
[ ] Plan and discussed how it should be deployed to PROD (If needed)

Additional comments (if any)
As a side note it raised some questions:

Should we be using the new 'Fine grained tokens' in future? (expiration date is mandatory)
Should we automate further the rotation process e.g. using GitHub API to generate new tokens and updating the secrets in AWS etc. ?

I've just added a new line to be clear that the runbook added is specifically only for the  github_ci_user_pat token. Hopefully it will make more sense when other runbooks are added in future.


Expose selected-country in a way that iron-form.serialize() can pick it up automaticly

For now i bound the value to a hidden input. It would be nice to have that feature build-in. Im not sure about the requirements but would be happy to look in to it.

Would be definitely worth to look into. Especially since I have a similar problem on another element as well. I think even some of the paper-elements had problems in that area. I'll look into it as well and let you know when I find something. But I won't get to it until beginning of October.

According to a discussion in the slack channel paper-inputs use an internal input that gets picked up by iron-form/form. I'll further look into it to get the required and auto-validate property working.

See this comment.


a little less memory copy

This is technically correct, but two reasons not to apply it:

Current code emulates realloc() behaviour, i.e. retains all values in the buffer. This is useful for low level impl. Following would fail in transition from short to long string representation with this PR.

cstr_buf b = cstr_buffer(&mystr);
while (...) {
   if (b.len == b.cap)
       b.str = cstr_reserve(&mystr, b.cap += b.cap);
   b.str[b.len++] input[i];
}
_cstr_set_size(b.len)

There is no speed benefit. Copying fixed size 24 bytes results in a few mov instructions instead of a "full" memcpy() call.  I will actually change to copy all 24 bytes (or 12) instead of only 23.

Btw, I am still in awe over your previous pull request! I had no idea it was possible to have the first switch case outside the block, which allowed this. Thanks again!!

Btw, I am still in awe over your previous pull request! I had no idea it was possible to have the first switch case outside the block, which allowed this. Thanks again!!

that's my honor, thank you!


struct.error

Do you have any suggestions why the error might be in softmax?
struct.error: 'I' format requires 0 <= number <=<PHONE_NUMBER>
I train my model, stop training, load model and resume training and have this error :-(
Actually i reimplement mha at my model with your functions and torch_blocksparse.MatMul worked well

It seems like there's an int argument of the Triton kernel that overflows. What are the matrix dimensions?

query size = [bs=1, seq_len=2048, emb_dim=1536]. sparsity.stride=1024, sparsity.block = 16
I suppose It was memory issue. TY!


Add test for changing SMTP.command_size_limit

What is the intended semantics of SMTP.command_size_limit? Is the user supposed to be allowed to change it? Changing it does not actually change the size limit of any particular command since command_size_limits is a defaultdict with fixed default value 512 -- which the failing test in this PR demonstrates. This is a relic from smtpd, and since smtpd doesn't document command_size_limit at all, this might be considered a private API.

The purpose of that is to support RFC 5321's default line length limit of 512 octets.  See section <IP_ADDRESS>.4.  But also, ESMTP allows for specifying different line lengths.  So we need to support both standards.
The specific implementation of this is a carryover from smtpd, and I don't particularly love it.  E.g. By being a class attribute, with a .clear() in the constructor, that makes it more difficult to override in a subclass.  I think both should just be normal instance attributes, with no .clear() call.  Any interest in working up a PR for that?

I'll see if I have time to look at reworking the implementation tonight and send a PR.

I've opened #58 with a refactoring of command_size_limit. While looking into the code I realized that aiosmtpd basically doesn't handle long lines from the client at all, so I implemented that in #59.

Closing this in favor of #58 and #59.


[Enhancement] Adds Visual Regression Testing to PR Environment Testing

Description
Adds ALL of our github templates and workflows
Adds template-specific collection of paths to test.
Motivation and Context
To catch issues/regressions introduced during new pull requests.
Types of changes
What types of changes does your code introduce? Put an x in all the boxes that apply:

[ ] Bug fix (non-breaking change which fixes an issue)
[X] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:
Go over all the following list, and put an x in all the boxes that apply. If you're unsure about what any of these mean, don't hesitate to ask. We're here to help!

[X] I have read the contribution guide
[X] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.

Superseded by #52


(maint) Merge 5.5.x -> 6.0.x

The fixes from device.rb are also needed in the 6.0.x branch. I've just confirmed the faulty behaviour with 6.0.10 from puppet-enterprise-2019.0.4-rc1-47-gb975b36-ubuntu-18.04-amd64 . I can provide an updated device.rb later today.

CLA signed by all contributors.

Jenkins please test this

The acceptance failure is in one of the device tests:
08:12:36 Failed Tests Cases:
08:12:36   Test Case tests/puppet_device_test.rb reported: #<Minitest::Assertion: cert requesting failed.
08:12:36 </Permission denied/> expected to not match
08:12:36 <"\e[1;31mError: Could not request certificate: Could not write /opt/puppetlabs/puppet/cache/devices/spinny1.example.com/ssl/private_keys/spinny1.example.com.pem to privatekeydir: Permission denied @ rb_sysopen - /opt/puppetlabs/puppet/cache/devices/spinny1.example.com/ssl/private_keys/spinny1.example.com.pem\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/file_system/file_impl.rb:31:in `initialize'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/file_system/file_impl.rb:31:in `open'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/file_system/file_impl.rb:31:in `open'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/file_system.rb:47:in `open'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/settings/directory_setting.rb:15:in `block in open_file'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/settings/file_setting.rb:241:in `block (2 levels) in controlled_access'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util.rb:142:in `withumask'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/settings/file_setting.rb:231:in `block in controlled_access'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/suidmanager.rb:74:in `asuser'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/settings/file_setting.rb:229:in `controlled_access'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/settings/directory_setting.rb:14:in `open_file'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/indirector/ssl_file.rb:147:in `write'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/indirector/ssl_file.rb:78:in `save'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/indirector/key/file.rb:34:in `save'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/indirector/indirection.rb:285:in `save'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/ssl/host.rb:80:in `generate_key'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/ssl/host.rb:121:in `certificate'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/ssl/host.rb:305:in `wait_for_cert'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application/device.rb:390:in `setup_host'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application/device.rb:279:in `block (3 levels) in main'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:65:in `override'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:252:in `override'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application/device.rb:258:in `block (2 levels) in main'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application/device.rb:256:in `each'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application/device.rb:256:in `collect'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application/device.rb:256:in `block in main'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:65:in `override'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:252:in `override'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application/device.rb:241:in `main'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application.rb:390:in `run_command'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application.rb:382:in `block in run'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util.rb:671:in `exit_on_fail'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application.rb:382:in `run'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/command_line.rb:139:in `run'\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/command_line.rb:77:in `execute'\n/opt/puppetlabs/puppet/bin/puppet:5:in `<main>'\e[0m\n">.>
08:12:36     Test line: tests/puppet_device_test.rb:48:in `block (2 levels) in run_test'

Jenkins please test this on osx1014-64a,redhat7-64a,ubuntu1604-64a,windows2012r2-64a

Jenkins please test this on osx1014-64a,redhat7-64a,ubuntu1604-64a,windows2012r2-64a

I need to prep for Contributor Summit next week and won't be available for this work until Jun 10th. cc @davidmalloncares

@joshcooper can we fix that in a following PR since it does not seem related to the merge-up? In this way we will be able to unblock the pipeline.
From what i see pool = Puppet::Network::HTTP::Pool.new(Puppet[:http_keepalive_timeout]) is already there, since those lines were not modified.

I'll take a look at this today


sentinl and kibana 5.5.3

Issue Description
I have to upgrade to kibana 5.5.3 due to the nasty bug https://github.com/elastic/kibana/pull/13830
When I install sentil, I have the message
Plugin installation was unsuccessful due to error "Incorrect Kibana version in plugin [sentinl]. Expected [5.5.3]; found [5.5.2]"

Reproducing the Issue step-by-step
upgrade to kibana 5.5.3 with yum install
install sentinl

Expected Results vs. Actual Results

Additional Details
please can you provide
https://github.com/sirensolutions/sentinl/releases/download/tag-5.5/sentinl-v5.5.3.zip
thanks,

@jmreymond The Sentinl 5.5.3 release is ready https://github.com/sirensolutions/sentinl/releases/download/tag-5.5/sentinl-v5.5.3.zip

thansK;
installation is ok but now, stranges messages as
log   [09:22:46.438] [info][status][Sentinl] Saving Watcher with ID: imx6x58ri9-0wnacfpwfs6d-l65mkyqozcc
Unhandled rejection Error: Cannot provide statusCode or message with boom error
    at Object.exports.assert (/usr/share/kibana-pirate/plugins/sentinl/node_modules/hoek/lib/index.js:736:11)
    at Object.exports.wrap (/usr/share/kibana-pirate/plugins/sentinl/node_modules/boom/lib/index.js:76:10)
    at Object.internals.create (/usr/share/kibana-pirate/plugins/sentinl/node_modules/boom/lib/index.js:94:24)
    at Object.exports.unauthorized (/usr/share/kibana-pirate/plugins/sentinl/node_modules/boom/lib/index.js:164:27)
    at handleESError (/usr/share/kibana-pirate/plugins/sentinl/server/lib/handle_es_error.js:47:21)
    at callWithRequest.then.then.catch.err (/usr/share/kibana-pirate/plugins/sentinl/server/routes/routes.js:245:29)
    at bound (domain.js:280:14)
    at runBound (domain.js:293:12)
    at tryCatcher (/usr/share/kibana-pirate/node_modules/bluebird/js/main/util.js:26:23)
    at Promise._settlePromiseFromHandler (/usr/share/kibana-pirate/node_modules/bluebird/js/main/promise.js:503:31)
    at Promise._settlePromiseAt (/usr/share/kibana-pirate/node_modules/bluebird/js/main/promise.js:577:18)
    at Promise._settlePromises (/usr/share/kibana-pirate/node_modules/bluebird/js/main/promise.js:693:14)
    at Async._drainQueue (/usr/share/kibana-pirate/node_modules/bluebird/js/main/async.js:123:16)
    at Async._drainQueues (/usr/share/kibana-pirate/node_modules/bluebird/js/main/async.js:133:10)
    at Immediate.Async.drainQueues (/usr/share/kibana-pirate/node_modules/bluebird/js/main/async.js:15:14)
    at runCallback (timers.js:672:20)
    at tryOnImmediate (timers.js:645:5)
    at processImmediate [as _immediateCallback] (timers.js:617:5
```)

@jmreymond can you save and execute a watcher?

@jmreymond do you see any error in the Sentinl UI?

no message in the Sentinl UI but run every is empty and throttle is empty

@jmreymond I've created an issue for this https://github.com/sirensolutions/sentinl/issues/225
The issue will be solved soon.


Does someone still have access to this repository?

Hello all. This is a grim issue indeed.
Unfortunately, Bolero Murakami passed away in February of this year. Since repository access is not publicly visible, does someone still have access in order to maintain this project?
Pinging the two top-most contributors: @kariya-mitsuru @osyo-manga

Thank you @bolero-MURAKAMI for all the work you did for the C++ community.

Really sad to learn about this! Such a bright programmer! RIP @bolero-MURAKAMI


flake8 warns F632 (use ==/!= to compare str)

chainer/variable.py:1781:16: F632 use ==/!= to compare str, bytes, and int literals
chainer/variable.py:1783:18: F632 use ==/!= to compare str, bytes, and int literals
chainer/functions/math/sparse_matmul.py:27:12: F632 use ==/!= to compare str, bytes, and int literals
chainer/functions/math/sparse_matmul.py:29:14: F632 use ==/!= to compare str, bytes, and int literals
chainer/functions/math/sparse_matmul.py:102:8: F632 use ==/!= to compare str, bytes, and int literals
tests/chainer_tests/iterators_tests/test_multiprocess_iterator.py:678:44: F632 use ==/!= to compare str, bytes, and int literals

setup.py in Chainer specifies 'flake8>=3.6,<3.7'.  F632 seems warned by flake8>=3.7.


Continuous 'Loading icon finder...'

Using Sketch, the plugin opens but continues to load 'icon finder' to no end. The plugin was working fine at the beginning of my design session but randomly stopped working. I tried closing and reopening the plugin, and restarting Sketch (as instructed), I also rebooted my Mac but still no success.

I've just started Sketch to test it, getting the same error too. That's good because I can finally debug that mysterious error!
Temporary fix that works for me: right click in plug-in window, select "Reload".

Looks like error is caused by Sketch Web View. It sometimes fails to send ready-to-show event.
Try updating to 1.1.8 that I've just published. It uses workaround for that event. Please tell me if it solved plug-in issue.

The "Reload" works for me also! Unfortunately though, update 1.1.8 doesn't seem to be working. When I select "Update" in the Plugin window, it doesn't run the update. It doesn't do anything. I seem to be stuck with an update I can't action.

Try installing manually from plug-in repository: https://github.com/iconify/iconify-sketch/releases
Download iconify.sketchplugin.zip for version 1.1.8, click zip file unpack it, click plug-in file to install.

That doesn't seem to work either. I have attached some photos of the messages I'm getting.
After clicking the plugin file I get 'Shot 1', I then press "Replace" and get 'Shot 2'. After that, nothing happens, update is still there.

I've made another attempt at publishing update, this time without Sketch Plugin Manager.
Version 1.1.9 is available here: https://github.com/iconify/iconify-sketch/releases/tag/1.1.9

Version 1.1.9 works temporarily but then crashes Sketch after a few moments. I tried it a few times with the same results.

Try file in attachment.
It is a very very early version of new generation of plug-in. It was written in last few hours based on upcoming Iconify Icon Finder. Whatever is causing Sketch to crash seem to not affect new code base.
This version is almost fully functional: that is it can search, browse and import icons, but could have some bugs because for icon import I've just copied code from old plug-in. Tomorrow I'll rewrite icon import process. At least it doesn't crash, unless you close plug-in window by clicking X in top left corner, but that seem to affect all plug-ins that use Sketch Web View. To close window without crashing use "Close" button in footer.
iconify.sketchplugin.zip

Amazing, works exactly as you said! I'll close the case for now and await the new version with the new import process. I appreciate the speedy response, thank you!

Awesome.
I've attached updated version with correct import process. It appends imported icons to current page, does not take into account selected layers. Improved import, which considers currently selected layers will take a bit longer to develop.
Other functionality: plug-in remembers last session and you can select multiple icons (button in top right corner above icons list toggles mode to select multiple icons).
Plugin still crashes when you close it by closing window. As far as I can tell by browsing various recent bug reports, it affects all plug-ins when running Sketch on Big Sur for at least few more people. Close button in footer closes plug-in without crashing.
iconify.sketchplugin.zip


Fix mirror checkpointer error on the alter database query

Steps to reproduce:

Set the fsync GUC to on.
Make changes to a database and move it to another tablespace, for example:

psql -c "create tablespace ts1 location '/tmp/ts'" postgres
psql -c "create database test" postgres
psql -c "create table t (i int)  DISTRIBUTED randomly" test
psql -c "alter database test SET TABLESPACE ts1" postgres

If a mirror checkpointer doesn't create checkpoint between "create table" and "alter database", then attempt to create checkpoint the next time will result in the file synchronization error, because the file doesn't exist. At the moment of checkpoint creating the database file has already been moved to a new tablespace, but fsync request to checkpointer was not changed.
In the end of copydir() function the database is fsynced, so it is necessary to cancel all fsync requests to checkpointer related to this database and don't add new ones in FlushDatabaseBuffers() before copydir() calling.

there is another solution in upstream/main

there is another solution in upstream/main

It is not the same case

@andr-sokolov, can you explain, Postgres 9.4 is affected by this problem? Or this code part is Greenplum-specific?

Closed in favor of #474


 I wanted to use the neural-style stuff for some experiments, and I think I have most everything working. It's running right now (cpu only, wanted to test it before I did all the cuda stuff) and I was wondering where the image output to? Like I run the script, given in the installation guide, it's running right now, but does it out put the render to a specific place on the hdd?

Unless you specify the output image, it is written to output.png in your neural-style folder.

Excellent, I see that now. Thank you.


optimize 3D view

[x] fix position of camera (right now, default view a little awkward for both matrix/single mode)
[x] currently, a little hard to click precisely on plots in matrix view (sometimes 1 attention head off)
[ ] change placement of layer/head labels too?

ok for now (added matrix tooltips to help with clicking)


Issue with github page

Github page support has been added to the repo. Please find the link to the page here :
https://vibharavi1.github.io/OSSE-Assignment/


tremor-rs: init at 0.10.1

Motivation for this change
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

Wow, that was a quick review. Thanks @SuperSandro2000!

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
If you have any questions or problems please reach out to SuperSandro2000 on IRC.
Result of nixpkgs-review pr 112004 run on x86_64-darwin 1

1 package failed to build and are new build failure:

tremor-rs: log https://termbin.com/7oou

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
If you have any questions or problems please reach out to SuperSandro2000 on IRC.
Result of nixpkgs-review pr 112004 run on x86_64-linux 1

1 package failed to build and are new build failure:

tremor-rs: log https://termbin.com/lofs

@SuperSandro2000 Is there a way I can modify the build phase just for darwin and not for other platforms?
ref: https://nixos.org/manual/nixpkgs/stable/#sec-darwin

@SuperSandro2000 Is there a way I can modify the build phase just for darwin and not for other platforms?
ref: nixos.org/manual/nixpkgs/stable/#sec-darwin

What do you want to do? We can set darwin specific stuff like lib.optionals stdenv.isDarwin [ clang ];.

What do you want to do? We can set darwin specific stuff like ++ lib.optionals stdenv.isDarwin [ clang ];.

I want to set the CXX variable so that it would use the g++ compiler. So something equivalent of this
CXX=/usr/local/bin/g++-10 cargo run -p tremor-cli

What do you want to do? We can set darwin specific stuff like ++ lib.optionals stdenv.isDarwin [ clang ];.

@SuperSandro2000 I want to set the CXX variable so that it would use the g++ compiler. So something equivalent of this
CC=/usr/local/bin/gcc-10 CXX=/usr/local/bin/g++-10 cargo build -p tremor-cli

It really can't use the cc and c++ compiler? Our build infrastructure currently does not allow overwriting those variables easily.

Our build infrastructure currently does not allow overwriting those variables easily.

:+1: I have removed darwin from the supported platforms.

@SuperSandro2000 PTAL


Prediction on values with no "Choice" column

It seems that prediction requires the data to be in long format, however if you have virgin data where choice is not known and are trying to predict what the choice will be, the wide_to_long function does not seem to allow for not specifying a choice column. Are there plans to fix this?

@mgrogger-mm Thanks for writing in!
Do you mean that you want to make predictions from a given model without having data on which to estimate the model (i.e. without having a choice column)?
One way around this is to create a fake choice column for your wide format data, then use that to pass your dataset to the wide_to_long function. One could have a separate utility function that would create such a column for users.
I don't have immediate plans to implement this, but I'd be happy to look over a PR for this functionality if you give it an initial attempt.

Closing due to inactivity.


chore(deps): update cobra to latest

Fixes #3669.
Signed-off-by: Geoff Baskwill<EMAIL_ADDRESS>

appveyor build broken, seems like it would be fixed by 4897


a lot of empty sub-compartment regions

Respected Author
Hi
Thank you very much for developing CALDER 2.0, a very useful tool !  When I used it I encountered a problem that the region of sub-compartment can not complete coverage of the genome regions and I feel these empty regions have lot. I also encountered this problem when I ran test data.
I look forward to hearing from you.
Best
Nutures

Hi, what do you mean by empty regions? I can see a gap for example between 1-20000 and 40001-380000.
This is not surprising because Calder will remove regions where contacts are too sparse. What is the total length of empty regions you get? Can you visualise how the Hi-C map looks like at these regions?

Thank you for your reply, I understood it.


feat(plugin-content-blog): add setGlobalData

When I use useGlobalData hook, I only get docusaurus-plugin-content-docs data, but I didn't see any data from docusaurus-plugin-content-blog, so I wanted to give it setGlobalData.

But I think that's all there is to it.

Sorry, we're not going to accept this, because it increases bundle size by 265 kB even for our tiny blog, which is far beyond acceptable. The doc global data is mostly needed because there are theme components like navbar doc items that need to access doc data on every page, and therefore it is carefully optimized and assured that only critical data is made global.
Please see #4492, https://github.com/facebook/docusaurus/issues/6923, and a few other related issues for discussions on how we can enable you to do this in userland (currently the only way is through plugin enhancement, as outlined in #4492). But I can assure you we are not interested in making this global data available out-of-the-box, especially since there's no sign of effort to reduce bundle size. If our own theme components/hooks don't use them, it's hard, if not impossible, to determine what's the right data to be made global.


issue after upgrade

I upgrade from the original release of netbox to the 1.4.2 and all of my devices are gone. I followed the instructions on the readmedocs. This are the errors I get in postgres:
ERROR: column dcim_device.primary_ip_id does not exist at character 2036
ERROR: column dcim_device.primary_ip_id does not exist at character 449
ERROR: column dcim_device.primary_ip_id does not exist at character 2045

Looks like it's querying for columns that were deprecated a few versions back. I would guess the WSGI is still running old code or it wasn't restarted.

umm I restarted nginx, I restart supervisord, I restart also netbox using supervisorctl restart netbox. Did I miss something?

figured it out. I had to change the gunicorn and supervisord config to the netbox-1.4.2 dir instead of the old one.


StackView duplicates plot API

With the refactoring of the plot axes (#909) and colormap (#913) it has become apparent that duplicating a subset of the plot API in StackView was a bad idea and is causing extra work.
I suggest that we deprecate the duplicated API (setGraphXLabel, resetZoom, getActiveImage, getGraphTitle,setGraphTitle,  isKeepDataAspectRatio, setKeepDataAspectRatio...) to give us the option of removing the methods in a few releases,  and just provide a getPlot() method to replace them all.
The only drawback to this is that it will indirectly expose the entire plot API instead of just the useful subset of methods.

What is the drawback of those methods just calling self.getPlot().methopName?

I believe it is preferable to be consistent throughout the project, so every time we change the "best practice" we need to fix all our internal code (e.g. https://github.com/silx-kit/silx/pull/909/files#diff-762cbffc2cee69b18c3551e1ee19bb85)

At no moment it was considered to get rid of those methods. They are there and that's it. A totally different thing is that we decided to use the object oriented API in our own code and temporarily marked those methods as deprecated.

I understand this for PlotWidget, but StackView is a higher level widget that did not necessarily need to implement the same API initially. It was done because I thought that it did not cost much to do so (my usual mistake).
The other alternative was to inherit PlotWidget, which would completely remove the issue of maintaining the API. But the issue is that it would directly expose methods that should preferably not be called (addImage...).

My point of view is that it was done and not on last release.
Considering that the functional API is frozen it should not cost anything to maintain it. Concerning the StackView was our (your?) choice to modify those methods to follow the object oriented API but it was not necessary. If the functional API would have been kept calling the (already frozen) functional API no maintenance changes would have been necessary at the StackView level.
To suppress those methods is for me the equivalent of suppressing them from PlotWidget and that is something that is not going to be made. The functional API is simply frozen but not deprecated. People has been using it because:

It is simpler to use interactively
There was an OpenGL binding already implemented with that API.

To me the getPlot method is a good way for StackView to provide the PlotWidget API.
Even if the PlotWidget API is 'frozen', with time and needs, we will most probably add methods and arguments to existing methods, and proxies will have to keep up, + they duplicate the documentation.


[RFC] Detect system default resolver

As discussed in #29 a PR that detects the system default resolver on *nix systems.

#48 adds a TimeoutExecutor, would it make sense to read the timeout option from resolve.conf and use that value to create the TimeoutExecutor?

#48 adds a TimeoutExecutor, would it make sense to read the timeout option from resolve.conf and use that value to create the TimeoutExecutor?

Most certainly! If @reactphp/core likes the proposed external API I'll go more in depth and add more features like the timeout option :smile: .

Any news on this guys? Any chance for it to being merged in next week?

What's with Windows? This PR will result in many written apps not being able to run on Windows.

Ping @jsor @clue, what do you think about the public facing API? If you like it I'll work it out into something that also works on windows and has a default fallback so it works if detection fails.

@clue we could go with something like this, where <IP_ADDRESS> is used as a fallback:
$loop = React\EventLoop\Factory::create();
$factory = new React\Dns\Resolver\Factory();
$dns = $factory->createCached(determineSystemDefaultServer('<IP_ADDRESS>'), $loop);

I added some comments regarding the implementation.
While it will usually work to read /etc/resolv.conf once, the nameservers in there might change, e.g. because a software might be running on a notebook that changes the access point (WLAN).


[Issue #83] Include a list of past bugs of a specific step/failure_type in description of new bugs

This pull request updates the description of new bugs to include a list of up to 10 of the most recent past bugs from a specific step and failure_type. For example, if step-1 has had a pod_failure failure type 5 types in the past and a new bug is being filed, the issue description of the new bug will include a table of those bugs in order of date create.
Here is an example of the new description in the stage environment:

/verified

/verified

/verified


include string_util.h for the prototype of gpr_strdup and fix a typo.

Fixes two warnings in log_win32.c under msvc2015
log_win32.c(109): warning C4013: 'gpr_strdup' undefined; assuming extern returning int
log_win32.c(109): warning C4047: 'return': 'char *' differs in levels of indirection from 'int'
and corrects a typo in an error message

On 6/14/2015 9:18 PM, googlebot wrote:

Thanks for your pull request. It looks like this may be your first
contribution to a Google open source project, in which case you'll
need to sign a Contributor License Agreement (CLA).
:memo: Please visit https://cla.developers.google.com/ to sign.
Once you've signed, please reply here (e.g. |I signed it!|) and we'll
verify. Thanks.

If you've already signed a CLA, it's possible we don't have your
GitHub username or you're using a different email address. Check
your existing CLA data https://cla.developers.google.com/clas
and verify that your email is set on your git commits
https://help.github.com/articles/setting-your-email-in-git/.
If you signed the CLA as a corporation, please let us know the
company's name.

—
Reply to this email directly or view it on GitHub
https://github.com/grpc/grpc/pull/2057#issuecomment-111916753.

I signed it


Add edit button to draftail images and embeds blocks tooltip

Fixes https://github.com/wagtail/wagtail/issues/2674
Adds an "Edit" button to the blocks tooltip and when clicked it opens the specific chooser for the media type with the current values populated.
Tested in:

[x] Chrome
[x] Firefox
[x] Edge
[x] Safari
[x] Opera

Unsure if I need to add some docs.
Thanks to @smendes and @gabriel-peracio for your help on this one.

@maylonpedroso looks good, tested this out for images and it works as expected, code appears to be fine from my perspective also + tests added (thanks!)
@thibaudcolas  - will leave you to review / merge if all good. or let me know if you want me to merge this one in.
Images

@lb- @thibaudcolas Any chance to merge this? I need exactly this feature

Screenshots using Chrome 84  on Android 9.
Image block

Embed block

Screenshots using IE 11 on Windows 10.
Image block

Embed block


Parameter value capitalization

Describe the bug
Module and definitions deployed fine.
Any subsequent plans include 84 changes for the parameter values to be changed e.g. "String" to "string". The value is lower case in the source TF definitions and I assume the Azure platform capitalizes it once pushed.
You can amend manually in the local module files as a workaround.
Steps to reproduce

Screenshots

Hi, apologies for the delay on this. I didn't receive a notificaiton. The issue was upstream in teh ES repo but I understadn that this is fixed now. I'll release a new version with the latest.

No problem, thanks for the update Matt. Will keep an eye out for the new release.
Cheers
Dan

v0.11 out now containing latest from upstream

Closing, please re-open if you are still affected


baseline feature performance issue

Hi, thanks for the great code, really appreciate it!
When I'm running downstream evaluation written by my self, I found that mfcc feature with utterance based speaker classification can reach high accuracy. But when I use s3prl to run. I get poor result, with command:

python preprocess/preprocess_libri.py --feature_type=mfcc --delta=True --delta_delta=True
python run_downstream.py --run=speaker_utterance --upstream=baseline --config=config/downstream.yaml --input_dim=39
the accuracy is 0.03~0.05

And I made some modification:

change learning rate in downstream.yaml to  0.001
python preprocess/preprocess_libri.py --feature_type=mfcc --delta=True --delta_delta=True --apply_cmvn=False
python run_downstream.py --run=speaker_utterance --upstream=baseline --config=config/downstream.yaml --input_dim=39

and the accuracy went to 0.88, could you please check for this? Did I misunderstood anything?

python preprocess/preprocess_libri.py --feature_type=mfcc --delta=True --delta_delta=True --apply_cmvn=False

Hi, thanks for the feedback!
I think the major cause is --apply_cmvn=False.
The normalization of cmvn will illuminate global information (a.k.a speaker identity)

Get it ! thanks for the quick reply!


[Feature] support async compaction for persistent index

More detail about this feature, check this #27581
In this PR, it mainly includes the following modifications:

Introducing the l2 layer to transform merge compaction into async compaction. By moving l1 to l2 each time, async compaction can be accomplished. Another benefit of introducing l2 is to facilitate concurrent control between the apply thread and background compaction thread in the code.
Adding a background compaction thread pool to periodically merge multiple l2 files into one l2 file.

And also add three configs:
// Control if using the async compaction strategy
enable_pindex_async_compaction = true
// if l2 num is larger than this, stop doing async compaction, add this config to prevent l2 grow too large.
max_allow_pindex_l2_num = 5
// control the background compaction threads per disk.
pindex_bg_compaction_num_threads_per_disk = 2

By enable async compaction, we can achieve better tail latency, thereby reducing overall latency fluctuations.

total record count
record count per upsert
disable async compaction
enable async compaction

5000000
1000
2.485 s
92 ms

10000000
1000
5.069 s
184 ms

5000000
5000
2.452 s
104 ms

10000000
5000
5.021 s
192 ms

What type of PR is this:

[ ] BugFix
[x] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Checklist:

[x] I have added test cases for my bug fix or my new feature
[ ] This pr will affect users' behaviors
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.1
[x] 3.0
[x] 2.5
[ ] 2.4

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)