Skip to content

Would you help me to solve a problem with sample codes? #1

@otheng03

Description

@otheng03

Hi~

This project is interesting.

I'm trying to run sample codes to get some insight into this project.

However, a problem arose.
Unknown desc = panic: runtime error: invalid memory address or nil pointer dereference.

Would you take a look at my problem?

golang version: go1.16.3
source version: tag: v0.3.46

8 workers and 1 master and etcd in localhost.

workers port : 12341 ~ 12348
worker command: go run ./test/cmd/workertest/main.go <port>
master command: go run ./test/cmd/mastertest/main.go

I got the below log messages when executed the master.

2021-06-02 19:07:59.375 V │ lrmr.cluster: master node registered as localhost:7600
2021-06-02 19:07:59.376 V │ lrmr: Planned 1 partitions on GroupByApp/_input (output with *lrmr.localInput):
  localhost:7600: _input

2021-06-02 19:07:59.376 V │ lrmr: Planned 96 partitions on GroupByApp/csvDecoder0 (output with *partitions.hashKeyPartitioner):
  127.0.0.1:12341: 5, 13, 21, 29, 37, 45, 53, 61, 69, 77, 85, 93
  127.0.0.1:12342: 7, 15, 23, 31, 39, 47, 55, 63, 71, 79, 87, 95
  127.0.0.1:12343: 2, 10, 18, 26, 34, 42, 50, 58, 66, 74, 82, 90
  127.0.0.1:12344: 6, 14, 22, 30, 38, 46, 54, 62, 70, 78, 86, 94
  127.0.0.1:12345: 1, 9, 17, 25, 33, 41, 49, 57, 65, 73, 81, 89
  127.0.0.1:12346: 0, 8, 16, 24, 32, 40, 48, 56, 64, 72, 80, 88
  127.0.0.1:12347: 3, 11, 19, 27, 35, 43, 51, 59, 67, 75, 83, 91
  127.0.0.1:12348: 4, 12, 20, 28, 36, 44, 52, 60, 68, 76, 84, 92

2021-06-02 19:07:59.376 V │ lrmr: Planned 96 partitions on GroupByApp/counter1 (output with *partitions.PreservePartitioner):
  127.0.0.1:12341: 5, 13, 21, 29, 37, 45, 53, 61, 69, 77, 85, 93
  127.0.0.1:12342: 7, 15, 23, 31, 39, 47, 55, 63, 71, 79, 87, 95
  127.0.0.1:12343: 2, 10, 18, 26, 34, 42, 50, 58, 66, 74, 82, 90
  127.0.0.1:12344: 6, 14, 22, 30, 38, 46, 54, 62, 70, 78, 86, 94
  127.0.0.1:12345: 1, 9, 17, 25, 33, 41, 49, 57, 65, 73, 81, 89
  127.0.0.1:12346: 0, 8, 16, 24, 32, 40, 48, 56, 64, 72, 80, 88
  127.0.0.1:12347: 3, 11, 19, 27, 35, 43, 51, 59, 67, 75, 83, 91
  127.0.0.1:12348: 4, 12, 20, 28, 36, 44, 52, 60, 68, 76, 84, 92

2021-06-02 19:07:59.385 F │ master: failed to run session: rpc error: code = Unknown desc = panic: runtime error: invalid memory address or nil pointer dereference
    runtime.panicmem (panic.go:212)
    runtime.sigpanic (signal_unix.go:734)
    github.com/ab180/lrmr/internal/serialization.Type.New (type.go:48)
    github.com/ab180/lrmr/internal/serialization.DeserializeStruct (struct.go:38)
    github.com/ab180/lrmr/partitions.(*SerializablePartitioner).UnmarshalJSON (partitioner.go:41)
    github.com/ab180/lrmr/internal/pbtypes.(*JSON).UnmarshalJSON (types.go:18)
    github.com/ab180/lrmr/worker.(*Worker).createTask (worker.go:155)
    github.com/ab180/lrmr/worker.(*Worker).CreateTasks.func1 (worker.go:145)
    github.com/ab180/lrmr/internal/errgroup.(*Group).Go.func1 (errgroup.go:69)
call CreateTask on 127.0.0.1:12346
github.com/ab180/lrmr/master.(*Master).StartJob.func1
        /Users/kakao/sources/lrmr/master/master.go:158
github.com/ab180/lrmr/internal/errgroup.(*Group).Go.func1
        /Users/kakao/sources/lrmr/internal/errgroup/errgroup.go:69
runtime.goexit
        /usr/local/Cellar/go/1.16.3/libexec/src/runtime/asm_amd64.s:1371
assign task
exit status 1

I hope your help.

Thank you.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions